-- Logs begin at Mon 2022-01-24 16:12:23 UTC, end at Mon 2022-01-24 17:09:01 UTC. -- Jan 24 16:36:47.529481 dv-cinder-826116-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 24 16:36:47.537041 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 24 16:36:47 2022] *** Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: nodename: dv-cinder-826116-1-iscsi Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: machine: x86_64 Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: clock source: unix Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: pcre jit disabled Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: detected number of CPU cores: 4 Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: current working directory: / Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: detected binary path: /usr/bin/uwsgi-core Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: your processes number limit is 47680 Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: your memory page size is 4096 bytes Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: detected max file descriptor number: 2048 Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: lock engine: pthread robust mutexes Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: thunder lock: enabled Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 24 16:36:47.541019 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 24 16:36:47.585842 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: Python main interpreter initialized at 0x562f009f99c0 Jan 24 16:36:47.585842 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: python threads support enabled Jan 24 16:36:47.585842 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: your server socket listen backlog is limited to 100 connections Jan 24 16:36:47.585842 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: your mercy for graceful operations on workers is 90 seconds Jan 24 16:36:47.586221 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: mapped 403077 bytes (393 KB) for 2 cores Jan 24 16:36:47.586297 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: *** Operational MODE: preforking *** Jan 24 16:36:47.586544 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: *** uWSGI is running in multiple interpreter mode *** Jan 24 16:36:47.586544 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: spawned uWSGI master process (pid: 90756) Jan 24 16:36:47.586776 dv-cinder-826116-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 24 16:36:47.588202 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: spawned uWSGI worker 1 (pid: 90770, cores: 1) Jan 24 16:36:47.588202 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: spawned uWSGI worker 2 (pid: 90771, cores: 1) Jan 24 16:36:47.588202 dv-cinder-826116-1-iscsi devstack@keystone.service[90756]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 24 16:36:53.474690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:36:53.474690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: from cryptography.utils import int_from_bytes Jan 24 16:36:53.475470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:36:53.475470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: from cryptography.utils import int_from_bytes Jan 24 16:36:53.475470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:36:53.475470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: from cryptography.utils import int_from_bytes Jan 24 16:36:53.475961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:36:53.475961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: from cryptography.utils import int_from_bytes Jan 24 16:36:53.520353 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 16:36:53.520556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 16:36:53.520642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 16:36:53.520733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] command line args: [] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 16:36:53.520816 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 16:36:53.520942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] command line args: [] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 16:36:53.521023 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 16:36:53.521143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ================================================================================ {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 16:36:53.521234 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 16:36:53.521382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ================================================================================ {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 16:36:53.521471 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] admin_token = **** {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.521633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] config_dir = [] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.521715 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] admin_token = **** {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.521825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.521908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] config_dir = [] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.522010 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] config_source = [] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.522094 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.522193 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] debug = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.522276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] config_source = [] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.522395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.522656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] debug = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.522656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.522837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.522899 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.522961 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.523023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.523208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.523295 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.523463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.523546 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.523700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] list_limit = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.523784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] list_limit = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.523886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] log_config_append = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.523958 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] log_config_append = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.524066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.524137 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.524234 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] log_dir = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.524303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] log_dir = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.524420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] log_file = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.524493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] log_file = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.524638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.524721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.524894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.525068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.525158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.525233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.525355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.525436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.525558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.525643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.525713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.525777 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.525926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.526014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.526175 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.526259 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.526410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.526491 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.526644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.526780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.526936 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.527031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.527136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.527211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.527384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.527473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.527631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.527754 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.527909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.528031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.528923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.117/identity {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.529021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.117/identity {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.529126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] publish_errors = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.529222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] publish_errors = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.529346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.529555 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.529674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.529753 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.529870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.529983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.529983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.530224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.530303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.530373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.530445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] standard_threads = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.530521 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] standard_threads = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.530629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.530712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.530912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531025 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] use_journal = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] use_journal = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531453 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] use_json = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531555 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] use_json = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531635 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] use_stderr = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] use_stderr = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] use_syslog = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531877 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] use_syslog = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.531972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.532093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:36:53.532233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.532355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.532477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.532600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.532739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.532864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.532984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.533140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.533238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.533348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.533478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.533590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.533729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.533848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.533968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.534083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.534219 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.534335 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.534472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.534588 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.534727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.534875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.535003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.535115 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.535256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.535352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.535498 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.535629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.535748 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.535830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.536000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.536084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.536241 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.536324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.536500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.536581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.536758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.536835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.537005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.537082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.537243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.537318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.537500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.537575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.537763 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.537838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.538017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.538143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.538268 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.538344 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.538499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.538580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.538731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.538869 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.539023 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.539102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.539216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.539292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.539465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.539546 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.539713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.539788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.539944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.540025 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.540173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.540247 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.540420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.540496 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.540667 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.540747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.540903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.540977 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.541151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.541227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.541387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.541464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.541623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.541697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.541858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.541933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.542089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.542169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.542318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.542398 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.542550 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.542657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.542807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.542907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.543032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.543142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.543384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.543473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.543583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.543657 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.543733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.543851 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.543956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.544729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.544819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.545081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.545167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.545246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.545364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.545443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.545514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.545626 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.545741 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.545874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.545981 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.546058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.546220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.546297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.546460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.546545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.546699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.546797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.546961 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.547040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.547212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.547288 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.547448 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.547530 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.547688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.547764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.547920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.548008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.548182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.548269 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.548419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.548547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.548675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.548789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.548909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.549041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.549167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.549286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.549420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.549548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.549672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.549802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.549924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.550053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.550177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.550299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.550428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.550558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.550682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.550824 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.550944 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.551070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.551209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.551411 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.551539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.551668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.551794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.551916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.552040 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.552171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.552295 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.552419 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.552542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.552665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.552789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.552919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.553054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.553185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.553309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.553432 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.553561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.553692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.553817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.553935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.554059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.554183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.554313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.554451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.554593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.554727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.554895 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.555019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.555146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.555270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.555404 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.555528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.555650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.555774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.555897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.556020 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.556153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] auth.external = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.556279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] auth.external = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.556401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.556537 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.556660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.556790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.556923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.557047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.557170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] auth.password = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.557293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] auth.password = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.557434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] auth.token = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.557508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] auth.token = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.557670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.557790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.557918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.558043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.558175 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.558299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.558430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.558553 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.558676 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.558820 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.558940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.559063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.559194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.559349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.559480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] credential.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.559605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] credential.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.559927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.560059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.560191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.560316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.560446 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.560572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.560697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.560821 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.560946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.561078 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.561210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.561336 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.561460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.561590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.561715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.561854 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.561986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.562111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.562237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.562361 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.562487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.562618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.562745 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.562893 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.563017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.563152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.563284 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.563416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.563543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.563677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.563802 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] federation.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.563926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] federation.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.564050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.564182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.564308 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.564433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.564558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.564683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.564807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.564938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.565064 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.565189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.565324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.565449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.565573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.565706 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.565832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.565956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.566080 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.566204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.566329 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.566535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.566663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.566802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.566921 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.567043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.567173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.567307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.567430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.567550 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.567670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.567791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.567911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.568047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.568170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.568290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.568410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.568531 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.568650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.568790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.568912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.569032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.569153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.569273 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.569393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.569526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.569649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.569769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.569890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.570010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.570137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.570270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.570393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.570524 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.570650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.570823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.570946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.571081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.571207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.571331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.571457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.571580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.571712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.571842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.571968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.572092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.572225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.572349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.572481 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.572606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.572730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.572854 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.572979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.573104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.573238 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.573363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.573488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.573612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.573740 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.573865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.574006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.574132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.574261 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.574386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.574510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.574634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.574783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.574905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.575024 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.575144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.575276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.575400 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.575531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.575612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.575746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.575865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.575986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.576107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.576235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.576355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.576475 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.576594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.576715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.576840 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.576968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.577090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.577210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.577335 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.577465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.577585 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.577713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.577835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.577955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.578074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.578194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.578315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.578441 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.578572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.578694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.578864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.578986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.579122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.579257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.579384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.579508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.579631 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.579755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.579878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.580009 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.580139 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.580263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.580388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.580512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.580640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.580774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.580908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.581032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.581156 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.581280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.581404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.581536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.581660 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.581784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.581908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.582032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.582155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.582286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.582417 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.582550 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.582675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.582814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.582934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.583063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.583184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.583303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.583423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.583543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.583662 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.583790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.583911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.584031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.584150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.584279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.584399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.584530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.584651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.584772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.584891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585030 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585238 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.585943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586161 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586230 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586368 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586554 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.586976 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587186 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587254 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] resource.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] resource.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.587948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588512 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588650 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.588935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589004 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] role.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] role.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] role.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589220 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] role.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589292 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589361 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589716 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.589993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590424 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590709 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.590876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.591512 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.591589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.591755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.591833 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.592010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.592236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.592484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.592562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.592743 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.592820 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.593000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.593084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.593253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.593330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.593506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.593583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.593742 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.593827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.593986 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.594069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.594245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.594332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.594490 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.594575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.594731 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.594830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.594990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.595068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.595225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.595318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.595464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.595543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.595722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.595798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.595973 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.596060 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.596216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.596293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.596457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.596533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.596689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.596774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.597030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.597108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] token.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.597271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.597348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] token.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.597513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.597597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.597757 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.597833 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.597996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.598073 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.598257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.598342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.598495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.598571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.598743 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.598865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.599012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.599100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.599263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.599340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.599502 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.599578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.599745 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.599830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.599984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.600061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.600222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.600298 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.600472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.600556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.600707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.600784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.600942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.601018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.601189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.601275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.601456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.connection = **** {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.601532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.601704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.601781 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.connection = **** {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.601952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.602036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.602191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.602267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.602433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.602509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.602667 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.602767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.602932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.603053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.603171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.603258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.603408 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.603494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.603646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.603722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.603907 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.603993 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.604148 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.604234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.604387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.604465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.604623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.604701 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.604870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.604946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.605106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.605191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.605342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.605419 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.605575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.605651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.605815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.605900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.605973 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 16:36:53.606299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:36:53.606465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 16:36:53.638665 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.638868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.639037 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.639116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.639189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.639262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.647773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.647870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.676968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.677195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.677278 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.677492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.730739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.731351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.783351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.783587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.783679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.783825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.850487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.850668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.850782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.850866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.851028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.851133 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.851252 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.851335 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.851471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.851553 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.851686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.851769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.875653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.875890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.875988 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.876146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.876239 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.876356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.876439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.876569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.876651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.876788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.876875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.877005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.877086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.877225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.891006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.891127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.903949 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.904068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.904183 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.904319 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.904403 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.904549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.904630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.904773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.904854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.904994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.905076 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.905213 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.905293 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.905432 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 24 16:36:53.923527 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.923632 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.923740 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 24 16:36:53.923822 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 24 16:36:53.924081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.924175 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.924284 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 24 16:36:53.924365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 24 16:36:53.924551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.924631 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.924812 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.924899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.925069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.925252 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.925339 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.925515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.936253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.936359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.936526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.936608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.936798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.936879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.937082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.937165 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.945120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.945204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.948470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.948565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.948754 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.948863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.949032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.949147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.949311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.949430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.949591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.949713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.949851 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.949976 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.950116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.950786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.950933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.951044 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.951233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.951331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.951555 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.951636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.951819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.951897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.978185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.978281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.979796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.979879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.980079 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.980159 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.985814 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.985905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.986049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.986129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.986323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.986411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.993528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.993724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.993805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.994006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.998979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.999072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:53.999266 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.999347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.999550 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.999630 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.999831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:53.999914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.000100 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.000180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.000371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.000460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.000636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.000716 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.000901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.000981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.019931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.020207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.021202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.021481 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.024674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.025991 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.028232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.028556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.029634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.029928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.033607 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.034920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.037248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.038603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.040807 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.041106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.041399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.041685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.041964 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.042203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.042285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.042502 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.042812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.043108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.043388 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.043678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.062138 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.062424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.062694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.062984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.063216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.063510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.063788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.064054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.070695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.071812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.072416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.072692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.073484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.073761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.076354 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.076633 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.076914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.077198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.077456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.077607 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.077737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.078018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.078303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.078598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.090697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.091040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.091322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.091610 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.091890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.091971 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.092162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.092243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.092439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.092520 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.092719 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.092998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.093281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.093557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.110493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.111861 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.113734 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.115089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.117001 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.118559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.118650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.120194 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.120279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.120597 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.120880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.122643 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.122943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.123220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.129089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.130502 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.130661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.132123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.133894 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.134183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.134466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.134778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.135349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.135641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.135928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.136214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.145772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.146063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.146340 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.147035 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.147327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.147610 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.154658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.154960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.155622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.155622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.155784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.155904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 24 16:36:54.156017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.156182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.156301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.156460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.156568 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.156733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.156876 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.157007 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.157193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.157362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.157613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.157857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.158125 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.158394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.158670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.158960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.257507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.257734 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.263515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.264166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.264688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.265193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 24 16:36:54.297077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562f009f99c0 pid: 90771 (default app) Jan 24 16:36:54.300649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c31dc-0a06-4afa-a184-aa1ab3422384 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:36:54.300946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c31dc-0a06-4afa-a184-aa1ab3422384 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:36:54.301233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c31dc-0a06-4afa-a184-aa1ab3422384 None None] PATH_INFO: `/v3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:36:54.305407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1/1] 10.222.0.117 () {50 vars in 796 bytes} [Mon Jan 24 16:36:54 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:36:54.311855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562f009f99c0 pid: 90770 (default app) Jan 24 16:37:02.518669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e2cc-3f33-4d49-8ab4-3f5b54baf5f7 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:02.519197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e2cc-3f33-4d49-8ab4-3f5b54baf5f7 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:02.519197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e2cc-3f33-4d49-8ab4-3f5b54baf5f7 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:02.521237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 2/2] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:37:02.528782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803bd69-5982-42a6-91ab-282a33bf9f91 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:02.529158 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803bd69-5982-42a6-91ab-282a33bf9f91 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:02.529343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803bd69-5982-42a6-91ab-282a33bf9f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:02.559926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG oslo_db.sqlalchemy.engines [None req-b803bd69-5982-42a6-91ab-282a33bf9f91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:37:02.760341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG passlib.handlers.bcrypt [None req-b803bd69-5982-42a6-91ab-282a33bf9f91 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=90770) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 24 16:37:02.760754 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG passlib.handlers.bcrypt [None req-b803bd69-5982-42a6-91ab-282a33bf9f91 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90770) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 24 16:37:02.816463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b803bd69-5982-42a6-91ab-282a33bf9f91 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:02.818025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b803bd69-5982-42a6-91ab-282a33bf9f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:02.945028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1/3] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:02 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:03.106991 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35e2cc-3f33-4d49-8ab4-3f5b54baf5f7 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:03.140869 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG oslo_db.sqlalchemy.engines [None req-fb35e2cc-3f33-4d49-8ab4-3f5b54baf5f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:37:03.268168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35e2cc-3f33-4d49-8ab4-3f5b54baf5f7 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:03.272466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa2bb2-44ca-4ec4-919b-2a399ed3818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:03.273115 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa2bb2-44ca-4ec4-919b-2a399ed3818c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:03.273400 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa2bb2-44ca-4ec4-919b-2a399ed3818c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:03.273678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa2bb2-44ca-4ec4-919b-2a399ed3818c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:03.281770 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa2bb2-44ca-4ec4-919b-2a399ed3818c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:03.332919 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.common.rbac_enforcer.enforcer [None req-66aa2bb2-44ca-4ec4-919b-2a399ed3818c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 24 16:37:03.333268 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa2bb2-44ca-4ec4-919b-2a399ed3818c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:03.342896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 3/4] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:03 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:03.348817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803bd69-5982-42a6-91ab-282a33bf9f91 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:03.363870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803bd69-5982-42a6-91ab-282a33bf9f91 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:03.368265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30fc76-95e1-412a-9636-728a9f43850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:03.369350 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30fc76-95e1-412a-9636-728a9f43850d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:03.369638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30fc76-95e1-412a-9636-728a9f43850d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:03.369926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30fc76-95e1-412a-9636-728a9f43850d admin admin] PATH_INFO: `/v3/projects/6e0f1fba09874be8ae22b37e033b5e57` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:03.372095 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30fc76-95e1-412a-9636-728a9f43850d admin admin] RBAC: Authorizing `identity:get_project(project_id=6e0f1fba09874be8ae22b37e033b5e57)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:03.422025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7f30fc76-95e1-412a-9636-728a9f43850d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 24 16:37:03.422368 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30fc76-95e1-412a-9636-728a9f43850d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:03.426907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 2/5] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:03 2022] GET /identity/v3/projects/6e0f1fba09874be8ae22b37e033b5e57 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:05.619127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264b1f-d0e5-44cd-9a86-e0dccee065d2 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:05.619634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264b1f-d0e5-44cd-9a86-e0dccee065d2 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:05.619737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264b1f-d0e5-44cd-9a86-e0dccee065d2 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:05.624943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 4/6] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:05 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:05.630279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5884d-9bd3-4930-abf0-ebf5fb38eda6 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:05.630682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5884d-9bd3-4930-abf0-ebf5fb38eda6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:05.630868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5884d-9bd3-4930-abf0-ebf5fb38eda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:05.650742 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b6f5884d-9bd3-4930-abf0-ebf5fb38eda6 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:05.652302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b6f5884d-9bd3-4930-abf0-ebf5fb38eda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:05.660266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 3/7] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:05 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:05.683017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65264b1f-d0e5-44cd-9a86-e0dccee065d2 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:05.696003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65264b1f-d0e5-44cd-9a86-e0dccee065d2 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:05.700243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20aef8-ecb4-490e-90b8-e5f4f4a18650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:05.700857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20aef8-ecb4-490e-90b8-e5f4f4a18650 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:05.701148 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20aef8-ecb4-490e-90b8-e5f4f4a18650 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:05.701423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20aef8-ecb4-490e-90b8-e5f4f4a18650 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:05.709279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20aef8-ecb4-490e-90b8-e5f4f4a18650 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:05.711068 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20aef8-ecb4-490e-90b8-e5f4f4a18650 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:05.720143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 5/8] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:05 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:37:05.725283 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5884d-9bd3-4930-abf0-ebf5fb38eda6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:05.735031 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5884d-9bd3-4930-abf0-ebf5fb38eda6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:05.739472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae0c40-cf54-4b6b-93fa-b4f47bb08660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:05.740341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae0c40-cf54-4b6b-93fa-b4f47bb08660 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:05.740617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae0c40-cf54-4b6b-93fa-b4f47bb08660 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:05.740885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae0c40-cf54-4b6b-93fa-b4f47bb08660 admin admin] PATH_INFO: `/v3/users/e3931bcf4ae942f8ab85de758142ef39` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:05.742296 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae0c40-cf54-4b6b-93fa-b4f47bb08660 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3931bcf4ae942f8ab85de758142ef39)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:05.744176 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae0c40-cf54-4b6b-93fa-b4f47bb08660 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:05.745697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 4/9] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:05 2022] GET /identity/v3/users/e3931bcf4ae942f8ab85de758142ef39 => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:08.006019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2429-cc20-4ecd-a494-b6691b73ef6b None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:08.006530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2429-cc20-4ecd-a494-b6691b73ef6b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:08.006713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2429-cc20-4ecd-a494-b6691b73ef6b None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:08.008549 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 6/10] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:08.014476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ddab2-b32d-472d-ab54-fa26fdee0512 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:08.014911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ddab2-b32d-472d-ab54-fa26fdee0512 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:08.015059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ddab2-b32d-472d-ab54-fa26fdee0512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:08.032322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-c67ddab2-b32d-472d-ab54-fa26fdee0512 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:08.033505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c67ddab2-b32d-472d-ab54-fa26fdee0512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:08.041010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 5/11] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:08 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:08.056227 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10fd8e-6dc9-4b28-aa39-1c7711913803 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:08.056514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10fd8e-6dc9-4b28-aa39-1c7711913803 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:08.056791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10fd8e-6dc9-4b28-aa39-1c7711913803 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:08.059059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 7/12] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:08.064266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dba2ec-9f5f-4592-8710-deb3e49af8c8 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:08.064437 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10fd8e-6dc9-4b28-aa39-1c7711913803 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:08.064556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dba2ec-9f5f-4592-8710-deb3e49af8c8 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:08.064838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dba2ec-9f5f-4592-8710-deb3e49af8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:08.076694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10fd8e-6dc9-4b28-aa39-1c7711913803 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:08.080881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d57b2-bb9b-4345-9809-1fd428df997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:08.081621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d57b2-bb9b-4345-9809-1fd428df997d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:08.081898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d57b2-bb9b-4345-9809-1fd428df997d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:08.082166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d57b2-bb9b-4345-9809-1fd428df997d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:08.083262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-c4dba2ec-9f5f-4592-8710-deb3e49af8c8 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:08.084454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c4dba2ec-9f5f-4592-8710-deb3e49af8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:08.092246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 6/13] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:08 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:08.097851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d57b2-bb9b-4345-9809-1fd428df997d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:08.104699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-649d57b2-bb9b-4345-9809-1fd428df997d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:08.106441 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 8/14] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:37:08.111982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dba2ec-9f5f-4592-8710-deb3e49af8c8 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:08.115172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d57b2-bb9b-4345-9809-1fd428df997d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:08.121830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dba2ec-9f5f-4592-8710-deb3e49af8c8 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:08.125306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d57b2-bb9b-4345-9809-1fd428df997d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:08.126196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9ab0-0bcb-4096-b864-e2665b481da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:08.126879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9ab0-0bcb-4096-b864-e2665b481da0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:08.127164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9ab0-0bcb-4096-b864-e2665b481da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:08.127436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9ab0-0bcb-4096-b864-e2665b481da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:08.128198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9ab0-0bcb-4096-b864-e2665b481da0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:08.128502 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9ab0-0bcb-4096-b864-e2665b481da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:08.129665 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd6e01-491c-40d9-a934-9f5f0e58d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:08.130237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-750b9ab0-0bcb-4096-b864-e2665b481da0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:08.130237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:37:08.130237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:37:08.130540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd6e01-491c-40d9-a934-9f5f0e58d608 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:08.130540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd6e01-491c-40d9-a934-9f5f0e58d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:08.130834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd6e01-491c-40d9-a934-9f5f0e58d608 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:08.131171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9ab0-0bcb-4096-b864-e2665b481da0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:08.139751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd6e01-491c-40d9-a934-9f5f0e58d608 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:08.141521 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd6e01-491c-40d9-a934-9f5f0e58d608 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:08.146214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 7/15] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:08.150432 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 9/16] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:08 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:37:08.151527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9ab0-0bcb-4096-b864-e2665b481da0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:08.155993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd6e01-491c-40d9-a934-9f5f0e58d608 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:08.161362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9ab0-0bcb-4096-b864-e2665b481da0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:08.164284 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd6e01-491c-40d9-a934-9f5f0e58d608 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:08.165956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1ddde-7233-4c8d-8a0a-94cf9afc755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:08.166859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1ddde-7233-4c8d-8a0a-94cf9afc755b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:08.167108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1ddde-7233-4c8d-8a0a-94cf9afc755b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:08.167383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1ddde-7233-4c8d-8a0a-94cf9afc755b admin admin] PATH_INFO: `/v3/users/e3931bcf4ae942f8ab85de758142ef39` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:08.168632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb2a32-7852-4b9a-b9f9-22dcc86ae27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:08.168774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1ddde-7233-4c8d-8a0a-94cf9afc755b admin admin] RBAC: Authorizing `identity:get_user(user_id=e3931bcf4ae942f8ab85de758142ef39)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:08.169381 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb2a32-7852-4b9a-b9f9-22dcc86ae27d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:08.169658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb2a32-7852-4b9a-b9f9-22dcc86ae27d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:08.169928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb2a32-7852-4b9a-b9f9-22dcc86ae27d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:08.170439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1ddde-7233-4c8d-8a0a-94cf9afc755b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:08.171465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb2a32-7852-4b9a-b9f9-22dcc86ae27d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:08.172178 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 8/17] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:08 2022] GET /identity/v3/users/e3931bcf4ae942f8ab85de758142ef39 => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:08.173257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb2a32-7852-4b9a-b9f9-22dcc86ae27d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:08.174801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 10/18] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:08.177033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1ddde-7233-4c8d-8a0a-94cf9afc755b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:08.187493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1ddde-7233-4c8d-8a0a-94cf9afc755b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:08.192107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855b632-0913-47ef-9524-7c7739ec04f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:08.192919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855b632-0913-47ef-9524-7c7739ec04f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:08.193197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855b632-0913-47ef-9524-7c7739ec04f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:08.193467 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855b632-0913-47ef-9524-7c7739ec04f8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:08.194722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855b632-0913-47ef-9524-7c7739ec04f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:08.196518 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855b632-0913-47ef-9524-7c7739ec04f8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:08.198343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 9/19] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:08.204659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb2a32-7852-4b9a-b9f9-22dcc86ae27d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:08.214703 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb2a32-7852-4b9a-b9f9-22dcc86ae27d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:08.219286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dea2c1-ff62-434f-b67d-9d4ab6be96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:08.219940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea2c1-ff62-434f-b67d-9d4ab6be96a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:08.220225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea2c1-ff62-434f-b67d-9d4ab6be96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:08.220502 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea2c1-ff62-434f-b67d-9d4ab6be96a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:08.221366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dea2c1-ff62-434f-b67d-9d4ab6be96a8 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.domain.id=default, user.id=e3931bcf4ae942f8ab85de758142ef39) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:08.221678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dea2c1-ff62-434f-b67d-9d4ab6be96a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:08.223507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-22dea2c1-ff62-434f-b67d-9d4ab6be96a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:08.223507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:37:08.223507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:37:08.224698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dea2c1-ff62-434f-b67d-9d4ab6be96a8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:08.235370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 11/20] 10.222.0.117 () {56 vars in 1348 bytes} [Mon Jan 24 16:37:08 2022] GET /identity/v3/role_assignments?user.id=e3931bcf4ae942f8ab85de758142ef39&scope.domain.id=default&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 234 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:10.723515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124903dc-2b79-446c-a1d9-f03c75f04cd1 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:10.724505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124903dc-2b79-446c-a1d9-f03c75f04cd1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:10.724985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124903dc-2b79-446c-a1d9-f03c75f04cd1 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:10.727488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 10/21] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:10.733917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d539e20-2384-4770-b75a-9f6c297f2d3d None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:10.734354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d539e20-2384-4770-b75a-9f6c297f2d3d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:10.734452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d539e20-2384-4770-b75a-9f6c297f2d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:10.784975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG passlib.handlers.bcrypt [None req-1d539e20-2384-4770-b75a-9f6c297f2d3d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=90771) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 24 16:37:10.785394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG passlib.handlers.bcrypt [None req-1d539e20-2384-4770-b75a-9f6c297f2d3d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90771) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 24 16:37:10.839480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6445a-8492-4d06-af37-e94922d73a8c None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:10.840693 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6445a-8492-4d06-af37-e94922d73a8c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:10.841187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6445a-8492-4d06-af37-e94922d73a8c None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:10.843550 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 11/22] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:37:10.849198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000f82f-2390-4d6e-b7a4-30e5e332546a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:10.849711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000f82f-2390-4d6e-b7a4-30e5e332546a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:10.850180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000f82f-2390-4d6e-b7a4-30e5e332546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:10.862800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-1d539e20-2384-4770-b75a-9f6c297f2d3d None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:10.862800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1d539e20-2384-4770-b75a-9f6c297f2d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:10.883670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 12/23] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:10 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:10.887277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-0000f82f-2390-4d6e-b7a4-30e5e332546a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:10.888726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0000f82f-2390-4d6e-b7a4-30e5e332546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:10.902982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 12/24] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:10 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:10.919445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d539e20-2384-4770-b75a-9f6c297f2d3d None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:10.928897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d539e20-2384-4770-b75a-9f6c297f2d3d None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:10.947464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203dfc5-ad5e-4142-aa57-00d2a3df022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:10.948708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203dfc5-ad5e-4142-aa57-00d2a3df022d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:10.949684 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203dfc5-ad5e-4142-aa57-00d2a3df022d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:10.950013 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000f82f-2390-4d6e-b7a4-30e5e332546a None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:10.950116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203dfc5-ad5e-4142-aa57-00d2a3df022d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:10.963903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000f82f-2390-4d6e-b7a4-30e5e332546a None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:10.968158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203dfc5-ad5e-4142-aa57-00d2a3df022d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:10.969168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4756612-1813-4d62-9263-0cfb142a9910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:10.970166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4756612-1813-4d62-9263-0cfb142a9910 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:10.970636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4756612-1813-4d62-9263-0cfb142a9910 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:10.971124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4756612-1813-4d62-9263-0cfb142a9910 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:10.983387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-9203dfc5-ad5e-4142-aa57-00d2a3df022d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:10.984886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 13/25] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:10.988718 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4756612-1813-4d62-9263-0cfb142a9910 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:10.990424 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203dfc5-ad5e-4142-aa57-00d2a3df022d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:10.996325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4756612-1813-4d62-9263-0cfb142a9910 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:11.004859 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203dfc5-ad5e-4142-aa57-00d2a3df022d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:11.019594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613325cf-29e8-4802-a458-d4afa1106055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:11.020551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613325cf-29e8-4802-a458-d4afa1106055 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.020972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613325cf-29e8-4802-a458-d4afa1106055 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.021386 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613325cf-29e8-4802-a458-d4afa1106055 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.022363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613325cf-29e8-4802-a458-d4afa1106055 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:11.022848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613325cf-29e8-4802-a458-d4afa1106055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:11.024083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-613325cf-29e8-4802-a458-d4afa1106055 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:11.024083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:37:11.024083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:37:11.025253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613325cf-29e8-4802-a458-d4afa1106055 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:11.033598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-c4756612-1813-4d62-9263-0cfb142a9910 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:37:11.033598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 13/26] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:11.035171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4756612-1813-4d62-9263-0cfb142a9910 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:11.050777 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4756612-1813-4d62-9263-0cfb142a9910 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:11.053531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 14/27] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:11.059757 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613325cf-29e8-4802-a458-d4afa1106055 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:11.061429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d37b7c-1f46-4ed7-abb8-f13d003f01ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:11.062316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37b7c-1f46-4ed7-abb8-f13d003f01ec admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.062815 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37b7c-1f46-4ed7-abb8-f13d003f01ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.063283 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37b7c-1f46-4ed7-abb8-f13d003f01ec admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.064233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d37b7c-1f46-4ed7-abb8-f13d003f01ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:11.064726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d37b7c-1f46-4ed7-abb8-f13d003f01ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:11.065948 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-e3d37b7c-1f46-4ed7-abb8-f13d003f01ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:11.065948 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:37:11.065948 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:37:11.067210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d37b7c-1f46-4ed7-abb8-f13d003f01ec admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:11.069866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613325cf-29e8-4802-a458-d4afa1106055 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:11.088397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88ac52-f663-4b4c-b1e7-04d2ee3c67d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:11.089330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88ac52-f663-4b4c-b1e7-04d2ee3c67d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.090151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88ac52-f663-4b4c-b1e7-04d2ee3c67d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.090425 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88ac52-f663-4b4c-b1e7-04d2ee3c67d0 admin admin] PATH_INFO: `/v3/users/e3931bcf4ae942f8ab85de758142ef39` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.095875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88ac52-f663-4b4c-b1e7-04d2ee3c67d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3931bcf4ae942f8ab85de758142ef39)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:11.097739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88ac52-f663-4b4c-b1e7-04d2ee3c67d0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:11.099629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 15/28] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:11 2022] GET /identity/v3/users/e3931bcf4ae942f8ab85de758142ef39 => generated 248 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:11.102246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 14/29] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:37:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:11.104555 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88ac52-f663-4b4c-b1e7-04d2ee3c67d0 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:11.108490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d37b7c-1f46-4ed7-abb8-f13d003f01ec admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:11.116870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88ac52-f663-4b4c-b1e7-04d2ee3c67d0 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:11.125647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d37b7c-1f46-4ed7-abb8-f13d003f01ec admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:11.132802 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7599208-7831-4c28-a629-8e3447dca208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:11.133846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599208-7831-4c28-a629-8e3447dca208 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.134327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599208-7831-4c28-a629-8e3447dca208 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.134799 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599208-7831-4c28-a629-8e3447dca208 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.137716 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7599208-7831-4c28-a629-8e3447dca208 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:11.139732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7599208-7831-4c28-a629-8e3447dca208 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:11.141834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 16/30] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:11 2022] GET /identity/v3/domains/default => generated 200 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:11.148112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7599208-7831-4c28-a629-8e3447dca208 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:11.155138 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45685307-78bc-4fef-8424-9c2fa21b03bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:11.156737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45685307-78bc-4fef-8424-9c2fa21b03bb admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.157197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45685307-78bc-4fef-8424-9c2fa21b03bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.157827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45685307-78bc-4fef-8424-9c2fa21b03bb admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.158767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45685307-78bc-4fef-8424-9c2fa21b03bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:11.159989 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-45685307-78bc-4fef-8424-9c2fa21b03bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:11.159989 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:37:11.159989 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:37:11.161525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45685307-78bc-4fef-8424-9c2fa21b03bb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:11.166976 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7599208-7831-4c28-a629-8e3447dca208 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:11.187642 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206900cb-10fa-4720-8413-a12df7b8c2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:11.188792 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206900cb-10fa-4720-8413-a12df7b8c2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.189204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206900cb-10fa-4720-8413-a12df7b8c2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.189611 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206900cb-10fa-4720-8413-a12df7b8c2c8 admin admin] PATH_INFO: `/v3/domains/default/users/e3931bcf4ae942f8ab85de758142ef39/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.195974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206900cb-10fa-4720-8413-a12df7b8c2c8 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e3931bcf4ae942f8ab85de758142ef39, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:11.197337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-206900cb-10fa-4720-8413-a12df7b8c2c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:11.197337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:37:11.197337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:37:11.199886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206900cb-10fa-4720-8413-a12df7b8c2c8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:11.336896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 17/31] 10.222.0.117 () {58 vars in 1387 bytes} [Mon Jan 24 16:37:11 2022] PUT /identity/v3/domains/default/users/e3931bcf4ae942f8ab85de758142ef39/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:37:11.338998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b435c-b9c3-41f4-b441-6cc4383d55f9 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.339434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b435c-b9c3-41f4-b441-6cc4383d55f9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.340571 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b435c-b9c3-41f4-b441-6cc4383d55f9 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.346069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 18/32] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:11 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:11.356552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b13f2-4092-4fc8-a2c7-e4c9aaaca1e9 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.357069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b13f2-4092-4fc8-a2c7-e4c9aaaca1e9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.357622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b13f2-4092-4fc8-a2c7-e4c9aaaca1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.362782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 15/33] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:37:11 2022] POST /identity/v3/projects => generated 302 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:37:11.392114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-846b13f2-4092-4fc8-a2c7-e4c9aaaca1e9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:11.394010 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-846b13f2-4092-4fc8-a2c7-e4c9aaaca1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:11.506367 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 19/34] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:11 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:11.564490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45685307-78bc-4fef-8424-9c2fa21b03bb admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:11.576815 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45685307-78bc-4fef-8424-9c2fa21b03bb admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:11.592754 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6510-80d4-4ea2-94c4-d37c961cfdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:11.593378 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6510-80d4-4ea2-94c4-d37c961cfdfa admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.593668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6510-80d4-4ea2-94c4-d37c961cfdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.593953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6510-80d4-4ea2-94c4-d37c961cfdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.594779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb6510-80d4-4ea2-94c4-d37c961cfdfa admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:11.596037 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-3bfb6510-80d4-4ea2-94c4-d37c961cfdfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:11.596037 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:37:11.596037 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:37:11.596704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5738f8-410d-4aad-9a14-9ca8de093077 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.597124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5738f8-410d-4aad-9a14-9ca8de093077 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.597540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5738f8-410d-4aad-9a14-9ca8de093077 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.597817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb6510-80d4-4ea2-94c4-d37c961cfdfa admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:11.599680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 20/35] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:37:11.605622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1390b7-7cd9-4f5b-b372-438e6866d59d None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.606263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1390b7-7cd9-4f5b-b372-438e6866d59d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.606736 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1390b7-7cd9-4f5b-b372-438e6866d59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.619276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 16/36] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:37:11 2022] POST /identity/v3/roles => generated 226 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:11.640081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5b1390b7-7cd9-4f5b-b372-438e6866d59d None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:11.641741 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5b1390b7-7cd9-4f5b-b372-438e6866d59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:11.656768 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 21/37] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:11 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:11.697909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6510-80d4-4ea2-94c4-d37c961cfdfa admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:11.712199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6510-80d4-4ea2-94c4-d37c961cfdfa admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:11.718414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce6236-bc51-4e13-a9b2-7c7494cc7d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:11.719377 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce6236-bc51-4e13-a9b2-7c7494cc7d4c admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:11.719813 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce6236-bc51-4e13-a9b2-7c7494cc7d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:11.720232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce6236-bc51-4e13-a9b2-7c7494cc7d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:11.721176 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce6236-bc51-4e13-a9b2-7c7494cc7d4c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:11.723082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce6236-bc51-4e13-a9b2-7c7494cc7d4c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:11.748500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 17/38] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:37:11 2022] POST /identity/v3/roles => generated 220 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:12.574450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a00d2-5776-47b8-aa13-fad9e7944d7e None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:12.575039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a00d2-5776-47b8-aa13-fad9e7944d7e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:12.575039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a00d2-5776-47b8-aa13-fad9e7944d7e None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:12.576861 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 22/39] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:12.582312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2b78-3b13-4096-b748-01b7fbe195d1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:12.582612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2b78-3b13-4096-b748-01b7fbe195d1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:12.582981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2b78-3b13-4096-b748-01b7fbe195d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:12.601679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a11f2b78-3b13-4096-b748-01b7fbe195d1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:12.603231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a11f2b78-3b13-4096-b748-01b7fbe195d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:12.612917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 18/40] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:12 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:12.635956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a00d2-5776-47b8-aa13-fad9e7944d7e None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:12.649224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a00d2-5776-47b8-aa13-fad9e7944d7e None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:12.654077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adab91-6e47-4845-9444-9afcaa81217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:12.654802 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adab91-6e47-4845-9444-9afcaa81217d admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:12.655069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adab91-6e47-4845-9444-9afcaa81217d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:12.655347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adab91-6e47-4845-9444-9afcaa81217d admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:12.656146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adab91-6e47-4845-9444-9afcaa81217d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:12.657411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-c6adab91-6e47-4845-9444-9afcaa81217d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:12.657411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:37:12.657411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:37:12.658347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adab91-6e47-4845-9444-9afcaa81217d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:12.675306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 23/41] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:37:12 2022] POST /identity/v3/roles => generated 224 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:12.739452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940a2bd-3037-4ee9-ba06-d391de00e7ac None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:12.739779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940a2bd-3037-4ee9-ba06-d391de00e7ac None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:12.740024 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940a2bd-3037-4ee9-ba06-d391de00e7ac None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:12.742025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 19/42] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:12.747929 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d916db-a6b1-40b3-88ac-d0d33fc904b9 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:12.748226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d916db-a6b1-40b3-88ac-d0d33fc904b9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:12.748512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d916db-a6b1-40b3-88ac-d0d33fc904b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:12.767278 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-44d916db-a6b1-40b3-88ac-d0d33fc904b9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:12.768523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-44d916db-a6b1-40b3-88ac-d0d33fc904b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:12.776825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 24/43] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:12 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:12.802156 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940a2bd-3037-4ee9-ba06-d391de00e7ac None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:12.814910 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940a2bd-3037-4ee9-ba06-d391de00e7ac None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:12.819357 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039e7c-55a7-4f9b-818f-7574c0dd4737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:12.820243 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039e7c-55a7-4f9b-818f-7574c0dd4737 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:12.820606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039e7c-55a7-4f9b-818f-7574c0dd4737 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:12.820894 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039e7c-55a7-4f9b-818f-7574c0dd4737 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:12.822160 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9039e7c-55a7-4f9b-818f-7574c0dd4737 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:12.824541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9039e7c-55a7-4f9b-818f-7574c0dd4737 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:12.826292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 20/44] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:12 2022] GET /identity/v3/domains/default => generated 200 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:12.831962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d916db-a6b1-40b3-88ac-d0d33fc904b9 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:12.841811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d916db-a6b1-40b3-88ac-d0d33fc904b9 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:12.846246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3278-ce95-4b4e-8232-1f488cf6d194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:12.846957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3278-ce95-4b4e-8232-1f488cf6d194 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:12.847240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3278-ce95-4b4e-8232-1f488cf6d194 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:12.847515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3278-ce95-4b4e-8232-1f488cf6d194 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:12.848235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3278-ce95-4b4e-8232-1f488cf6d194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:12.849256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-e4dc3278-ce95-4b4e-8232-1f488cf6d194 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:12.849256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:37:12.849256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:37:12.850477 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3278-ce95-4b4e-8232-1f488cf6d194 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:12.878457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 25/45] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:37:12 2022] POST /identity/v3/projects => generated 313 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:37:13.758303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57285ae-97dc-4624-a6af-b8c8123fb70b None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:13.758585 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57285ae-97dc-4624-a6af-b8c8123fb70b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:13.758892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57285ae-97dc-4624-a6af-b8c8123fb70b None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:13.760800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 21/46] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:13.766398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57e043-68c6-419e-8a02-0b7105177905 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:13.766883 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57e043-68c6-419e-8a02-0b7105177905 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:13.767010 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57e043-68c6-419e-8a02-0b7105177905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:13.785450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4e57e043-68c6-419e-8a02-0b7105177905 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:13.786628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4e57e043-68c6-419e-8a02-0b7105177905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:13.842439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 26/47] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:13 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:13.865707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57285ae-97dc-4624-a6af-b8c8123fb70b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:13.877744 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57285ae-97dc-4624-a6af-b8c8123fb70b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:13.881876 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fceca-6357-4f18-833a-0319a4dac63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:13.882649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fceca-6357-4f18-833a-0319a4dac63a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:13.883028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fceca-6357-4f18-833a-0319a4dac63a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:13.883313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fceca-6357-4f18-833a-0319a4dac63a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:13.894917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fceca-6357-4f18-833a-0319a4dac63a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:13.901603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-519fceca-6357-4f18-833a-0319a4dac63a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:13.903468 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 22/48] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:13.909022 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57e043-68c6-419e-8a02-0b7105177905 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:13.917912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57e043-68c6-419e-8a02-0b7105177905 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:13.922241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4983fb-8404-4946-81a5-115098c94e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:13.922923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4983fb-8404-4946-81a5-115098c94e61 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:13.923208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4983fb-8404-4946-81a5-115098c94e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:13.923483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4983fb-8404-4946-81a5-115098c94e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:13.924246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4983fb-8404-4946-81a5-115098c94e61 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:13.924577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4983fb-8404-4946-81a5-115098c94e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:13.926195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4983fb-8404-4946-81a5-115098c94e61 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:13.935292 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 27/49] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:13.940456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fceca-6357-4f18-833a-0319a4dac63a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:13.951382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fceca-6357-4f18-833a-0319a4dac63a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:13.955912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33045632-be06-48be-85f3-c7d8a5116c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:13.956767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33045632-be06-48be-85f3-c7d8a5116c7f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:13.957051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33045632-be06-48be-85f3-c7d8a5116c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:13.957330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33045632-be06-48be-85f3-c7d8a5116c7f admin admin] PATH_INFO: `/v3/users/e3931bcf4ae942f8ab85de758142ef39` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:13.958542 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33045632-be06-48be-85f3-c7d8a5116c7f admin admin] RBAC: Authorizing `identity:get_user(user_id=e3931bcf4ae942f8ab85de758142ef39)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:13.960409 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33045632-be06-48be-85f3-c7d8a5116c7f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:13.961981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 23/50] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:13 2022] GET /identity/v3/users/e3931bcf4ae942f8ab85de758142ef39 => generated 248 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:13.967569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4983fb-8404-4946-81a5-115098c94e61 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:13.976960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4983fb-8404-4946-81a5-115098c94e61 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:13.981538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffb756-e72e-4917-947b-ed3b2fdcf9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:13.983164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb756-e72e-4917-947b-ed3b2fdcf9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:13.983450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb756-e72e-4917-947b-ed3b2fdcf9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:13.983723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb756-e72e-4917-947b-ed3b2fdcf9e7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:13.984917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffb756-e72e-4917-947b-ed3b2fdcf9e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:13.986616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffb756-e72e-4917-947b-ed3b2fdcf9e7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:13.988355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 28/51] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:13 2022] GET /identity/v3/domains/default => generated 200 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:13.993612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33045632-be06-48be-85f3-c7d8a5116c7f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:14.005112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33045632-be06-48be-85f3-c7d8a5116c7f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:14.013557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fba61-12ca-44b8-83e6-a06cc98756a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:14.014505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fba61-12ca-44b8-83e6-a06cc98756a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:14.015105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fba61-12ca-44b8-83e6-a06cc98756a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:14.015387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fba61-12ca-44b8-83e6-a06cc98756a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:14.016617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fba61-12ca-44b8-83e6-a06cc98756a7 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.domain.id=default, user.id=e3931bcf4ae942f8ab85de758142ef39) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:14.016928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fba61-12ca-44b8-83e6-a06cc98756a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:14.017982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-b62fba61-12ca-44b8-83e6-a06cc98756a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:14.017982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:37:14.017982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:37:14.019189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fba61-12ca-44b8-83e6-a06cc98756a7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:14.027178 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 24/52] 10.222.0.117 () {56 vars in 1348 bytes} [Mon Jan 24 16:37:13 2022] GET /identity/v3/role_assignments?user.id=e3931bcf4ae942f8ab85de758142ef39&scope.domain.id=default&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 532 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:15.106653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74481ac4-d6ab-4ba8-b9b6-d0b3646aa6f5 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:15.107216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74481ac4-d6ab-4ba8-b9b6-d0b3646aa6f5 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:15.107305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74481ac4-d6ab-4ba8-b9b6-d0b3646aa6f5 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:15.109039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 29/53] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:15.114134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ba1a-df82-4d1d-a80d-51d363ed1d90 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:15.114537 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ba1a-df82-4d1d-a80d-51d363ed1d90 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:15.114706 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ba1a-df82-4d1d-a80d-51d363ed1d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:15.132918 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-9020ba1a-df82-4d1d-a80d-51d363ed1d90 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:15.134109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9020ba1a-df82-4d1d-a80d-51d363ed1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:15.141667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 25/54] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:15 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:15.164339 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74481ac4-d6ab-4ba8-b9b6-d0b3646aa6f5 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:15.177312 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74481ac4-d6ab-4ba8-b9b6-d0b3646aa6f5 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:15.181521 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0ea96-92a6-4a08-afd4-bc98859acfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:15.182286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0ea96-92a6-4a08-afd4-bc98859acfce admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:15.182573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0ea96-92a6-4a08-afd4-bc98859acfce admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:15.182895 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0ea96-92a6-4a08-afd4-bc98859acfce admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:15.185257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0ea96-92a6-4a08-afd4-bc98859acfce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:15.186997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0ea96-92a6-4a08-afd4-bc98859acfce admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:15.188535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 30/55] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:15 2022] GET /identity/v3/domains/default => generated 200 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:15.193559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020ba1a-df82-4d1d-a80d-51d363ed1d90 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:15.202482 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020ba1a-df82-4d1d-a80d-51d363ed1d90 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:15.206803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388d16c-6dea-4cc5-a451-e5f3c8afcaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:15.207468 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388d16c-6dea-4cc5-a451-e5f3c8afcaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:15.207749 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388d16c-6dea-4cc5-a451-e5f3c8afcaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:15.208022 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388d16c-6dea-4cc5-a451-e5f3c8afcaa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:15.208753 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388d16c-6dea-4cc5-a451-e5f3c8afcaa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:15.210664 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388d16c-6dea-4cc5-a451-e5f3c8afcaa3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:15.235120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 26/56] 10.222.0.117 () {60 vars in 1166 bytes} [Mon Jan 24 16:37:15 2022] POST /identity/v3/projects => generated 299 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:17.452817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e6009-c848-432f-aa9d-4846f0eeab24 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:17.453300 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e6009-c848-432f-aa9d-4846f0eeab24 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:17.453300 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e6009-c848-432f-aa9d-4846f0eeab24 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:17.455093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 31/57] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:17.460519 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951267e-0a87-451f-bd19-96abf4927150 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:17.460925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951267e-0a87-451f-bd19-96abf4927150 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:17.461075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951267e-0a87-451f-bd19-96abf4927150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:17.478740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-9951267e-0a87-451f-bd19-96abf4927150 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:17.480188 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9951267e-0a87-451f-bd19-96abf4927150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:17.534699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 27/58] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:17 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:17.560806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e6009-c848-432f-aa9d-4846f0eeab24 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:17.572492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e6009-c848-432f-aa9d-4846f0eeab24 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:17.577020 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc4351-b72f-42cf-989c-9dc694982899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:17.577779 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc4351-b72f-42cf-989c-9dc694982899 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:17.578062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc4351-b72f-42cf-989c-9dc694982899 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:17.578338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc4351-b72f-42cf-989c-9dc694982899 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:17.579542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc4351-b72f-42cf-989c-9dc694982899 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:17.581192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc4351-b72f-42cf-989c-9dc694982899 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:17.582718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 32/59] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:17.587709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951267e-0a87-451f-bd19-96abf4927150 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:17.596567 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951267e-0a87-451f-bd19-96abf4927150 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:17.600845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a377ac-bd99-47e7-8a22-e941fe163ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:17.601490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a377ac-bd99-47e7-8a22-e941fe163ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:17.601772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a377ac-bd99-47e7-8a22-e941fe163ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:17.602047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a377ac-bd99-47e7-8a22-e941fe163ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:17.602803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a377ac-bd99-47e7-8a22-e941fe163ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:17.603826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-47a377ac-bd99-47e7-8a22-e941fe163ec6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:17.603826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:37:17.603826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:37:17.605595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a377ac-bd99-47e7-8a22-e941fe163ec6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:17.629776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 28/60] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:37:17 2022] POST /identity/v3/users => generated 276 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:21.065731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc503cf-7a1c-4d99-a985-9c6ad8145a58 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.066640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc503cf-7a1c-4d99-a985-9c6ad8145a58 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.067100 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc503cf-7a1c-4d99-a985-9c6ad8145a58 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.069037 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 33/61] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:21.074983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11d2e-214b-4238-94e7-24c8b814f6ae None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.075420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11d2e-214b-4238-94e7-24c8b814f6ae None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.075552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11d2e-214b-4238-94e7-24c8b814f6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.103772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-3ec11d2e-214b-4238-94e7-24c8b814f6ae None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:21.105523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3ec11d2e-214b-4238-94e7-24c8b814f6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:21.113938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 29/62] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:21 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:21.150430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc503cf-7a1c-4d99-a985-9c6ad8145a58 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.166422 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b82b-8e76-43de-98f9-b5e6aa6acb25 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.167589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b82b-8e76-43de-98f9-b5e6aa6acb25 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.168063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b82b-8e76-43de-98f9-b5e6aa6acb25 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.170286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 30/63] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:21 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:37:21.173039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc503cf-7a1c-4d99-a985-9c6ad8145a58 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.176933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d33061-9c1c-4739-b30b-b94f8b57ffb3 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.177526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d33061-9c1c-4739-b30b-b94f8b57ffb3 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.178060 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d33061-9c1c-4739-b30b-b94f8b57ffb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.178837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900900-27b3-4d30-bcd4-4b3879d51324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.179629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900900-27b3-4d30-bcd4-4b3879d51324 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.179915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900900-27b3-4d30-bcd4-4b3879d51324 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.180226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900900-27b3-4d30-bcd4-4b3879d51324 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.200671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1900900-27b3-4d30-bcd4-4b3879d51324 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:21.209434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-e1900900-27b3-4d30-bcd4-4b3879d51324 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:21.210645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 34/64] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:21.216346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-26d33061-9c1c-4739-b30b-b94f8b57ffb3 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:21.217552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-26d33061-9c1c-4739-b30b-b94f8b57ffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:21.219567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900900-27b3-4d30-bcd4-4b3879d51324 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.236180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 31/65] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:21 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:21.238691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900900-27b3-4d30-bcd4-4b3879d51324 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.250172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853dee7-646e-47a9-a8c5-b65274cb9151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.251145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853dee7-646e-47a9-a8c5-b65274cb9151 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.251622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853dee7-646e-47a9-a8c5-b65274cb9151 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.252084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853dee7-646e-47a9-a8c5-b65274cb9151 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.253036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853dee7-646e-47a9-a8c5-b65274cb9151 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:21.253524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853dee7-646e-47a9-a8c5-b65274cb9151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.255362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853dee7-646e-47a9-a8c5-b65274cb9151 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.263830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d33061-9c1c-4739-b30b-b94f8b57ffb3 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.265901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 35/66] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:21.273297 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853dee7-646e-47a9-a8c5-b65274cb9151 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.277223 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d33061-9c1c-4739-b30b-b94f8b57ffb3 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.283237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853dee7-646e-47a9-a8c5-b65274cb9151 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.287957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9b53a-95f0-45c9-b7c3-becd0954ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.288820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9b53a-95f0-45c9-b7c3-becd0954ed7a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.289104 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9b53a-95f0-45c9-b7c3-becd0954ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.289381 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9b53a-95f0-45c9-b7c3-becd0954ed7a admin admin] PATH_INFO: `/v3/users/be71d63e60ba4d298e036a36c092685f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.294456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d23fb-5abb-4039-81bc-d6277a4d17c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.295297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d23fb-5abb-4039-81bc-d6277a4d17c0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.295577 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d23fb-5abb-4039-81bc-d6277a4d17c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.295853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d23fb-5abb-4039-81bc-d6277a4d17c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.306455 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9b53a-95f0-45c9-b7c3-becd0954ed7a admin admin] RBAC: Authorizing `identity:get_user(user_id=be71d63e60ba4d298e036a36c092685f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.309309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9b53a-95f0-45c9-b7c3-becd0954ed7a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.311335 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 36/67] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/users/be71d63e60ba4d298e036a36c092685f => generated 276 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.318957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9b53a-95f0-45c9-b7c3-becd0954ed7a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.327176 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d23fb-5abb-4039-81bc-d6277a4d17c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:21.334052 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-bb7d23fb-5abb-4039-81bc-d6277a4d17c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:21.335308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 32/68] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:21.340862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9b53a-95f0-45c9-b7c3-becd0954ed7a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.343144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d23fb-5abb-4039-81bc-d6277a4d17c0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.355851 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d23fb-5abb-4039-81bc-d6277a4d17c0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.356646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af811ae6-266d-4e26-a12e-480abcac5a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.357480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af811ae6-266d-4e26-a12e-480abcac5a44 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.357898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af811ae6-266d-4e26-a12e-480abcac5a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.358318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af811ae6-266d-4e26-a12e-480abcac5a44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.367140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af811ae6-266d-4e26-a12e-480abcac5a44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.369106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af811ae6-266d-4e26-a12e-480abcac5a44 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.371447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dba05-dd8a-49e2-981e-6ff4b8ff9cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.372226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dba05-dd8a-49e2-981e-6ff4b8ff9cab admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.372610 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dba05-dd8a-49e2-981e-6ff4b8ff9cab admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.372987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dba05-dd8a-49e2-981e-6ff4b8ff9cab admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.373885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dba05-dd8a-49e2-981e-6ff4b8ff9cab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:21.374295 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dba05-dd8a-49e2-981e-6ff4b8ff9cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.376035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dba05-dd8a-49e2-981e-6ff4b8ff9cab admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.380042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 37/69] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:21.381463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b199db-965d-4f25-b849-85390776d1e1 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.381966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b199db-965d-4f25-b849-85390776d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.382451 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b199db-965d-4f25-b849-85390776d1e1 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.384582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 38/70] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:21.387468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b199db-965d-4f25-b849-85390776d1e1 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.392841 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 33/71] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.394345 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c628d8-b6ff-4973-9c3b-5b81544718bc None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.399025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c628d8-b6ff-4973-9c3b-5b81544718bc None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.399532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c628d8-b6ff-4973-9c3b-5b81544718bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.403322 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b199db-965d-4f25-b849-85390776d1e1 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.408883 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e35713-8769-4b36-bcc1-3829a7458f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.409724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e35713-8769-4b36-bcc1-3829a7458f21 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.410006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e35713-8769-4b36-bcc1-3829a7458f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.410284 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e35713-8769-4b36-bcc1-3829a7458f21 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.411519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e35713-8769-4b36-bcc1-3829a7458f21 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.413601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e35713-8769-4b36-bcc1-3829a7458f21 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.418809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 39/72] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:21.418809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e35713-8769-4b36-bcc1-3829a7458f21 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.425004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-f3c628d8-b6ff-4973-9c3b-5b81544718bc None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:21.426430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f3c628d8-b6ff-4973-9c3b-5b81544718bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:21.427417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e35713-8769-4b36-bcc1-3829a7458f21 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.432274 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357a6e1-3445-48a8-8817-7dfd2e6dbe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.434076 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357a6e1-3445-48a8-8817-7dfd2e6dbe1c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.434363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357a6e1-3445-48a8-8817-7dfd2e6dbe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.434643 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357a6e1-3445-48a8-8817-7dfd2e6dbe1c admin admin] PATH_INFO: `/v3/users/e3931bcf4ae942f8ab85de758142ef39` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.435944 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357a6e1-3445-48a8-8817-7dfd2e6dbe1c admin admin] RBAC: Authorizing `identity:get_user(user_id=e3931bcf4ae942f8ab85de758142ef39)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.436622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 34/73] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:21 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:21.437634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c628d8-b6ff-4973-9c3b-5b81544718bc None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.438108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357a6e1-3445-48a8-8817-7dfd2e6dbe1c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.444050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 40/74] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/users/e3931bcf4ae942f8ab85de758142ef39 => generated 248 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.449343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90873109-f9de-457d-89f1-ac5b2d78046b None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.449656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90873109-f9de-457d-89f1-ac5b2d78046b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.449910 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90873109-f9de-457d-89f1-ac5b2d78046b None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.454813 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c628d8-b6ff-4973-9c3b-5b81544718bc None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.456189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 41/75] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:21 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:21.457135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90873109-f9de-457d-89f1-ac5b2d78046b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.460971 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3548d-8c1b-4ec6-8cf5-c0b594e0b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.461944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3548d-8c1b-4ec6-8cf5-c0b594e0b059 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.462389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3548d-8c1b-4ec6-8cf5-c0b594e0b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.462846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3548d-8c1b-4ec6-8cf5-c0b594e0b059 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.464404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3548d-8c1b-4ec6-8cf5-c0b594e0b059 admin admin] RBAC: Adding query filter params (role.id=42656495a54b4164862c9a31838a731e, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b, user.id=be71d63e60ba4d298e036a36c092685f) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:21.464870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3548d-8c1b-4ec6-8cf5-c0b594e0b059 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.467004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3548d-8c1b-4ec6-8cf5-c0b594e0b059 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.471904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90873109-f9de-457d-89f1-ac5b2d78046b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.473157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 35/76] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/role_assignments?user.id=be71d63e60ba4d298e036a36c092685f&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=42656495a54b4164862c9a31838a731e => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.474291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7dde-4e53-4204-97f5-3f12abb2415b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.474789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7dde-4e53-4204-97f5-3f12abb2415b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.474914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7dde-4e53-4204-97f5-3f12abb2415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.482073 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbada713-620c-41f9-ad66-90adbde71175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.482866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbada713-620c-41f9-ad66-90adbde71175 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.483158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbada713-620c-41f9-ad66-90adbde71175 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.483440 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbada713-620c-41f9-ad66-90adbde71175 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.492466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbada713-620c-41f9-ad66-90adbde71175 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.494284 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbada713-620c-41f9-ad66-90adbde71175 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.497110 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-bb8c7dde-4e53-4204-97f5-3f12abb2415b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:21.498469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-bb8c7dde-4e53-4204-97f5-3f12abb2415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:21.504935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 42/77] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:21.505781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbada713-620c-41f9-ad66-90adbde71175 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.511588 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 36/78] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:21 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:21.512434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c7dde-4e53-4204-97f5-3f12abb2415b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.522186 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c7dde-4e53-4204-97f5-3f12abb2415b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.527480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515205b1-c5de-44b9-b363-a532e1712dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.528480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515205b1-c5de-44b9-b363-a532e1712dfd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.528859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515205b1-c5de-44b9-b363-a532e1712dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.529239 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515205b1-c5de-44b9-b363-a532e1712dfd admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.529730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbada713-620c-41f9-ad66-90adbde71175 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.530638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515205b1-c5de-44b9-b363-a532e1712dfd admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.532848 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515205b1-c5de-44b9-b363-a532e1712dfd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.534977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 37/79] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.540702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515205b1-c5de-44b9-b363-a532e1712dfd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.544524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee528b-063f-4760-bc7c-6c03114a0ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.545358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee528b-063f-4760-bc7c-6c03114a0ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.545641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee528b-063f-4760-bc7c-6c03114a0ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.545918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee528b-063f-4760-bc7c-6c03114a0ba9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.551952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515205b1-c5de-44b9-b363-a532e1712dfd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.556932 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397796b-5943-44f2-afaf-79b510c634d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.558003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397796b-5943-44f2-afaf-79b510c634d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.558383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397796b-5943-44f2-afaf-79b510c634d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.558777 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397796b-5943-44f2-afaf-79b510c634d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.559741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397796b-5943-44f2-afaf-79b510c634d0 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b, user.id=e3931bcf4ae942f8ab85de758142ef39) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:21.560122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397796b-5943-44f2-afaf-79b510c634d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.560598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee528b-063f-4760-bc7c-6c03114a0ba9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:21.562155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397796b-5943-44f2-afaf-79b510c634d0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.568310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-18ee528b-063f-4760-bc7c-6c03114a0ba9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:21.568507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 38/80] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/role_assignments?user.id=e3931bcf4ae942f8ab85de758142ef39&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.569424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397796b-5943-44f2-afaf-79b510c634d0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.569828 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 43/81] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:21.579935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee528b-063f-4760-bc7c-6c03114a0ba9 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.593130 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee528b-063f-4760-bc7c-6c03114a0ba9 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.598644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397796b-5943-44f2-afaf-79b510c634d0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.599436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd56083-2dd2-4747-8eb4-64de7de8d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.600398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd56083-2dd2-4747-8eb4-64de7de8d18c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.600897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd56083-2dd2-4747-8eb4-64de7de8d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.601400 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd56083-2dd2-4747-8eb4-64de7de8d18c admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.602401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd56083-2dd2-4747-8eb4-64de7de8d18c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:21.602942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd56083-2dd2-4747-8eb4-64de7de8d18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.605742 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd56083-2dd2-4747-8eb4-64de7de8d18c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.610828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aedb4-4012-4bee-b3d6-6e5a2fcd2068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.611778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aedb4-4012-4bee-b3d6-6e5a2fcd2068 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.612063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aedb4-4012-4bee-b3d6-6e5a2fcd2068 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.612343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aedb4-4012-4bee-b3d6-6e5a2fcd2068 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.617928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 44/82] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.624795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd56083-2dd2-4747-8eb4-64de7de8d18c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.636897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd56083-2dd2-4747-8eb4-64de7de8d18c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.642176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198ded5-dcd7-46d4-b0c1-0bf7d2fb0329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.643923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59aedb4-4012-4bee-b3d6-6e5a2fcd2068 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:21.644036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198ded5-dcd7-46d4-b0c1-0bf7d2fb0329 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.644694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198ded5-dcd7-46d4-b0c1-0bf7d2fb0329 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.645382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198ded5-dcd7-46d4-b0c1-0bf7d2fb0329 admin admin] PATH_INFO: `/v3/users/be71d63e60ba4d298e036a36c092685f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.647399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198ded5-dcd7-46d4-b0c1-0bf7d2fb0329 admin admin] RBAC: Authorizing `identity:get_user(user_id=be71d63e60ba4d298e036a36c092685f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.649832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198ded5-dcd7-46d4-b0c1-0bf7d2fb0329 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.652036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-c59aedb4-4012-4bee-b3d6-6e5a2fcd2068 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:21.653050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 39/83] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:21.653618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 45/84] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/users/be71d63e60ba4d298e036a36c092685f => generated 276 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.659233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aedb4-4012-4bee-b3d6-6e5a2fcd2068 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.659689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198ded5-dcd7-46d4-b0c1-0bf7d2fb0329 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.671649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198ded5-dcd7-46d4-b0c1-0bf7d2fb0329 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.678465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae582f-04ee-4cfe-8814-110570b18cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.679668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae582f-04ee-4cfe-8814-110570b18cbc admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.680193 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae582f-04ee-4cfe-8814-110570b18cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.680683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae582f-04ee-4cfe-8814-110570b18cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.681677 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae582f-04ee-4cfe-8814-110570b18cbc admin admin] RBAC: Adding query filter params (name=member) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:21.682291 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae582f-04ee-4cfe-8814-110570b18cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.684523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae582f-04ee-4cfe-8814-110570b18cbc admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.684986 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aedb4-4012-4bee-b3d6-6e5a2fcd2068 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.690968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0020-2733-4aee-8142-1544c5b7d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.691913 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0020-2733-4aee-8142-1544c5b7d516 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.691913 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0020-2733-4aee-8142-1544c5b7d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.692175 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0020-2733-4aee-8142-1544c5b7d516 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.696992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 46/85] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.703658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae582f-04ee-4cfe-8814-110570b18cbc admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.707929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf0020-2733-4aee-8142-1544c5b7d516 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.709787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf0020-2733-4aee-8142-1544c5b7d516 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.720820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae582f-04ee-4cfe-8814-110570b18cbc admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.724039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 40/86] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:21.725621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cd001-16b3-4f18-b978-c3bbfba7f2a7 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.725833 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aab1a-9c90-44c4-a52d-4a597321cb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.725956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cd001-16b3-4f18-b978-c3bbfba7f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.726280 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cd001-16b3-4f18-b978-c3bbfba7f2a7 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.727021 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aab1a-9c90-44c4-a52d-4a597321cb11 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.727409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aab1a-9c90-44c4-a52d-4a597321cb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.727787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aab1a-9c90-44c4-a52d-4a597321cb11 admin admin] PATH_INFO: `/v3/users/be71d63e60ba4d298e036a36c092685f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.728716 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 41/87] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:21.731932 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cd001-16b3-4f18-b978-c3bbfba7f2a7 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.734693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aab1a-9c90-44c4-a52d-4a597321cb11 admin admin] RBAC: Authorizing `identity:get_user(user_id=be71d63e60ba4d298e036a36c092685f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.736932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aab1a-9c90-44c4-a52d-4a597321cb11 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.738839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 47/88] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/users/be71d63e60ba4d298e036a36c092685f => generated 276 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.741839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596bff5-a265-4942-a4eb-33cd66a2d21c None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.742124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596bff5-a265-4942-a4eb-33cd66a2d21c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.742404 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596bff5-a265-4942-a4eb-33cd66a2d21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.754726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cd001-16b3-4f18-b978-c3bbfba7f2a7 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.759924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5da3-6b9f-4056-8f6d-2d8f3a0d3ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.761765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5da3-6b9f-4056-8f6d-2d8f3a0d3ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.762090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5da3-6b9f-4056-8f6d-2d8f3a0d3ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.762375 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5da3-6b9f-4056-8f6d-2d8f3a0d3ff9 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.764057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a5da3-6b9f-4056-8f6d-2d8f3a0d3ff9 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.766184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a5da3-6b9f-4056-8f6d-2d8f3a0d3ff9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.768198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 42/89] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.768801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5da3-6b9f-4056-8f6d-2d8f3a0d3ff9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.771979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d596bff5-a265-4942-a4eb-33cd66a2d21c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:21.773600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d596bff5-a265-4942-a4eb-33cd66a2d21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:21.780931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5da3-6b9f-4056-8f6d-2d8f3a0d3ff9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.785116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 48/90] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:21 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:21.786416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102abf0-fc42-410f-bd05-2cf59bf3e6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.786786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102abf0-fc42-410f-bd05-2cf59bf3e6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.787173 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102abf0-fc42-410f-bd05-2cf59bf3e6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.787452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102abf0-fc42-410f-bd05-2cf59bf3e6f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.788199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596bff5-a265-4942-a4eb-33cd66a2d21c None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.798151 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102abf0-fc42-410f-bd05-2cf59bf3e6f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.799967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596bff5-a265-4942-a4eb-33cd66a2d21c None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.800165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102abf0-fc42-410f-bd05-2cf59bf3e6f1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.805086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec35ee-e8ec-4fb7-8d27-fe1203576ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.806462 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec35ee-e8ec-4fb7-8d27-fe1203576ccc admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.807261 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec35ee-e8ec-4fb7-8d27-fe1203576ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.807823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec35ee-e8ec-4fb7-8d27-fe1203576ccc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.809184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec35ee-e8ec-4fb7-8d27-fe1203576ccc admin admin] RBAC: Adding query filter params (role.id=2d582daf740f43a8bd4b4471a3c1a99a, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b, user.id=be71d63e60ba4d298e036a36c092685f) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:21.809699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec35ee-e8ec-4fb7-8d27-fe1203576ccc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.810208 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 43/91] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:21.812159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec35ee-e8ec-4fb7-8d27-fe1203576ccc admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.815484 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102abf0-fc42-410f-bd05-2cf59bf3e6f1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.818820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 49/92] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/role_assignments?user.id=be71d63e60ba4d298e036a36c092685f&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=2d582daf740f43a8bd4b4471a3c1a99a => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.820279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec35ee-e8ec-4fb7-8d27-fe1203576ccc admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.826312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102abf0-fc42-410f-bd05-2cf59bf3e6f1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.832740 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec35ee-e8ec-4fb7-8d27-fe1203576ccc admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.836187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916b29f-8768-4da1-b1eb-19ae58ba6ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.836987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b29f-8768-4da1-b1eb-19ae58ba6ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.837268 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b29f-8768-4da1-b1eb-19ae58ba6ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.837541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b29f-8768-4da1-b1eb-19ae58ba6ae1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.839789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916b29f-8768-4da1-b1eb-19ae58ba6ae1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.841510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916b29f-8768-4da1-b1eb-19ae58ba6ae1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.843285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 44/93] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/domains/default => generated 200 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.845944 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb222560-4295-4233-86dd-3beaf0e35566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.847249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222560-4295-4233-86dd-3beaf0e35566 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.847853 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222560-4295-4233-86dd-3beaf0e35566 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.848350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222560-4295-4233-86dd-3beaf0e35566 admin admin] PATH_INFO: `/v3/projects/337321d8fb89444fb6a2d364594f9df3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.848640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916b29f-8768-4da1-b1eb-19ae58ba6ae1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.850530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb222560-4295-4233-86dd-3beaf0e35566 admin admin] RBAC: Authorizing `identity:get_project(project_id=337321d8fb89444fb6a2d364594f9df3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.853098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb222560-4295-4233-86dd-3beaf0e35566 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.857714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 50/94] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/projects/337321d8fb89444fb6a2d364594f9df3 => generated 313 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:21.865036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916b29f-8768-4da1-b1eb-19ae58ba6ae1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.865353 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb222560-4295-4233-86dd-3beaf0e35566 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:21.870857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a44763-039b-46bb-939e-ed35ee6517d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.871647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a44763-039b-46bb-939e-ed35ee6517d1 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.871983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a44763-039b-46bb-939e-ed35ee6517d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.872300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a44763-039b-46bb-939e-ed35ee6517d1 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.873100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a44763-039b-46bb-939e-ed35ee6517d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.878784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a44763-039b-46bb-939e-ed35ee6517d1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.887777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb222560-4295-4233-86dd-3beaf0e35566 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:21.900943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e619e-27fd-4565-9f12-a8159f9299ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:21.902646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e619e-27fd-4565-9f12-a8159f9299ce admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:21.905299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e619e-27fd-4565-9f12-a8159f9299ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:21.905598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e619e-27fd-4565-9f12-a8159f9299ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:21.906743 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e619e-27fd-4565-9f12-a8159f9299ce admin admin] RBAC: Adding query filter params (role.id=42656495a54b4164862c9a31838a731e, scope.project.id=337321d8fb89444fb6a2d364594f9df3, user.id=be71d63e60ba4d298e036a36c092685f) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:21.907084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e619e-27fd-4565-9f12-a8159f9299ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:21.907777 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 45/95] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:37:21 2022] POST /identity/v3/users => generated 290 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:21.909781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e619e-27fd-4565-9f12-a8159f9299ce admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:21.917400 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 51/96] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:21 2022] GET /identity/v3/role_assignments?user.id=be71d63e60ba4d298e036a36c092685f&scope.project.id=337321d8fb89444fb6a2d364594f9df3&role.id=42656495a54b4164862c9a31838a731e => generated 260 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:24.126741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2fd90-d209-410a-8dd8-54f304cc37d3 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.127264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2fd90-d209-410a-8dd8-54f304cc37d3 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.127364 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2fd90-d209-410a-8dd8-54f304cc37d3 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.129312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 46/97] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:24.137356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ada12-4ec3-495d-8f16-ebeb6c057d83 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.138273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ada12-4ec3-495d-8f16-ebeb6c057d83 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.138796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ada12-4ec3-495d-8f16-ebeb6c057d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.168404 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-240ada12-4ec3-495d-8f16-ebeb6c057d83 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:24.169641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-240ada12-4ec3-495d-8f16-ebeb6c057d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:24.181411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 52/98] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:24 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:24.220907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2fd90-d209-410a-8dd8-54f304cc37d3 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:24.236765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2fd90-d209-410a-8dd8-54f304cc37d3 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:24.244890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e388577-a081-4714-8890-0d28a9d1e9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:24.245686 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e388577-a081-4714-8890-0d28a9d1e9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.245987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e388577-a081-4714-8890-0d28a9d1e9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.246234 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e388577-a081-4714-8890-0d28a9d1e9a6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.260282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e388577-a081-4714-8890-0d28a9d1e9a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:24.267599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-3e388577-a081-4714-8890-0d28a9d1e9a6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:24.268814 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 47/99] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:24.274578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ada12-4ec3-495d-8f16-ebeb6c057d83 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:24.287833 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ada12-4ec3-495d-8f16-ebeb6c057d83 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:24.296214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e0dce-1635-4f80-b48f-9a0e2475853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:24.296875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0dce-1635-4f80-b48f-9a0e2475853f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.297159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0dce-1635-4f80-b48f-9a0e2475853f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.297433 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0dce-1635-4f80-b48f-9a0e2475853f admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.298190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e0dce-1635-4f80-b48f-9a0e2475853f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:24.298496 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e0dce-1635-4f80-b48f-9a0e2475853f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:24.300108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e0dce-1635-4f80-b48f-9a0e2475853f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:24.315337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 53/100] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:24.320608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e388577-a081-4714-8890-0d28a9d1e9a6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:24.335850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e388577-a081-4714-8890-0d28a9d1e9a6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:24.344752 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1f930-67f9-4fc1-91f0-c022205ca095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:24.345631 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1f930-67f9-4fc1-91f0-c022205ca095 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.345912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1f930-67f9-4fc1-91f0-c022205ca095 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.346189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1f930-67f9-4fc1-91f0-c022205ca095 admin admin] PATH_INFO: `/v3/users/e3931bcf4ae942f8ab85de758142ef39` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.347455 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1f930-67f9-4fc1-91f0-c022205ca095 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3931bcf4ae942f8ab85de758142ef39)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:24.349508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1f930-67f9-4fc1-91f0-c022205ca095 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:24.351142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 48/101] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:24 2022] GET /identity/v3/users/e3931bcf4ae942f8ab85de758142ef39 => generated 248 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:24.357557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e0dce-1635-4f80-b48f-9a0e2475853f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:24.372290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e0dce-1635-4f80-b48f-9a0e2475853f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:24.380246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d9f94-5ff5-495b-9910-57ed050dbfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:24.381036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9f94-5ff5-495b-9910-57ed050dbfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.381318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9f94-5ff5-495b-9910-57ed050dbfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.381588 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9f94-5ff5-495b-9910-57ed050dbfd0 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.382806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d9f94-5ff5-495b-9910-57ed050dbfd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:24.384884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d9f94-5ff5-495b-9910-57ed050dbfd0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:24.386834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 54/102] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:24 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:24.392354 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1f930-67f9-4fc1-91f0-c022205ca095 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:24.408286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1f930-67f9-4fc1-91f0-c022205ca095 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:24.415339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ba606-e029-4e59-acbc-61ccf2b9c785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:24.416252 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ba606-e029-4e59-acbc-61ccf2b9c785 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.416537 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ba606-e029-4e59-acbc-61ccf2b9c785 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.417536 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ba606-e029-4e59-acbc-61ccf2b9c785 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/users/e3931bcf4ae942f8ab85de758142ef39/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.419815 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ba606-e029-4e59-acbc-61ccf2b9c785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3035a30a67154f908dd0a8d0bd3d5b2b, user_id=e3931bcf4ae942f8ab85de758142ef39, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:24.420892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-014ba606-e029-4e59-acbc-61ccf2b9c785 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:24.420892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:37:24.420892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:37:24.422892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ba606-e029-4e59-acbc-61ccf2b9c785 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:24.447613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 49/103] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:37:24 2022] PUT /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/users/e3931bcf4ae942f8ab85de758142ef39/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:37:24.706248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a5abc-c4ba-4769-bd16-5ceedad01875 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.706582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a5abc-c4ba-4769-bd16-5ceedad01875 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.706765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a5abc-c4ba-4769-bd16-5ceedad01875 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.708576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 55/104] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:24.714841 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb9bd7-6637-4860-970f-89ad845503d0 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.715199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb9bd7-6637-4860-970f-89ad845503d0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.715509 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb9bd7-6637-4860-970f-89ad845503d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.739796 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e3bb9bd7-6637-4860-970f-89ad845503d0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:24.740987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e3bb9bd7-6637-4860-970f-89ad845503d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:24.805453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eb618-d134-4717-ad04-f37ca6075726 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.805752 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eb618-d134-4717-ad04-f37ca6075726 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.806004 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eb618-d134-4717-ad04-f37ca6075726 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.807839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 56/105] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:24.814230 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9c3ba-a62c-4fc8-a948-d9e5b264437f None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.814515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9c3ba-a62c-4fc8-a948-d9e5b264437f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.814814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9c3ba-a62c-4fc8-a948-d9e5b264437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.838229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 50/106] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:24 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:24.843182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b0e9c3ba-a62c-4fc8-a948-d9e5b264437f None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:24.844372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b0e9c3ba-a62c-4fc8-a948-d9e5b264437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:24.856432 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 57/107] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:24 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:24.863016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb9bd7-6637-4860-970f-89ad845503d0 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:24.872196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb9bd7-6637-4860-970f-89ad845503d0 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:24.882376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb69d68-a46d-4d57-8142-5397152e4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:24.883206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb69d68-a46d-4d57-8142-5397152e4c35 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.883494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb69d68-a46d-4d57-8142-5397152e4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.883775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb69d68-a46d-4d57-8142-5397152e4c35 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.894218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9c3ba-a62c-4fc8-a948-d9e5b264437f None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:24.898194 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb69d68-a46d-4d57-8142-5397152e4c35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:24.907630 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-5bb69d68-a46d-4d57-8142-5397152e4c35 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:24.909102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 51/108] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:24.912132 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9c3ba-a62c-4fc8-a948-d9e5b264437f None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:24.917412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb69d68-a46d-4d57-8142-5397152e4c35 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:24.924769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ffc5c-2905-4ddd-b121-988d18da2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:24.925762 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ffc5c-2905-4ddd-b121-988d18da2a5a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.926195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ffc5c-2905-4ddd-b121-988d18da2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.926469 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ffc5c-2905-4ddd-b121-988d18da2a5a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.930472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb69d68-a46d-4d57-8142-5397152e4c35 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:24.936147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0021c-24eb-4df1-8083-364ef975d8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:24.937020 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0021c-24eb-4df1-8083-364ef975d8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.937479 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0021c-24eb-4df1-8083-364ef975d8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.937954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0021c-24eb-4df1-8083-364ef975d8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.939341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0021c-24eb-4df1-8083-364ef975d8f2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:24.939823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0021c-24eb-4df1-8083-364ef975d8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:24.941827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0021c-24eb-4df1-8083-364ef975d8f2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:24.951867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 52/109] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:24 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:24.957148 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ffc5c-2905-4ddd-b121-988d18da2a5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:24.958429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0021c-24eb-4df1-8083-364ef975d8f2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:24.965125 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-3d8ffc5c-2905-4ddd-b121-988d18da2a5a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:24.972291 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 58/110] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:37:24.973449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ffc5c-2905-4ddd-b121-988d18da2a5a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:24.974590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0021c-24eb-4df1-8083-364ef975d8f2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:24.982776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90990af-c266-4ec9-84ef-e22d393a781b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:24.982776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90990af-c266-4ec9-84ef-e22d393a781b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:24.982776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90990af-c266-4ec9-84ef-e22d393a781b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:24.982776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90990af-c266-4ec9-84ef-e22d393a781b admin admin] PATH_INFO: `/v3/users/be71d63e60ba4d298e036a36c092685f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:24.983496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90990af-c266-4ec9-84ef-e22d393a781b admin admin] RBAC: Authorizing `identity:get_user(user_id=be71d63e60ba4d298e036a36c092685f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:24.986648 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90990af-c266-4ec9-84ef-e22d393a781b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:24.988295 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ffc5c-2905-4ddd-b121-988d18da2a5a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:24.988411 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 53/111] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:24 2022] GET /identity/v3/users/be71d63e60ba4d298e036a36c092685f => generated 276 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:24.994008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90990af-c266-4ec9-84ef-e22d393a781b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:25.001272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdec29-20b7-4fc3-891d-25624a041122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:25.003062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdec29-20b7-4fc3-891d-25624a041122 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.003350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdec29-20b7-4fc3-891d-25624a041122 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.003631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdec29-20b7-4fc3-891d-25624a041122 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.004407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdec29-20b7-4fc3-891d-25624a041122 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:25.004715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdec29-20b7-4fc3-891d-25624a041122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:25.011515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90990af-c266-4ec9-84ef-e22d393a781b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:25.013535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdec29-20b7-4fc3-891d-25624a041122 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:25.027132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951453b-a765-4936-bad4-5fc663c5fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:25.028116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951453b-a765-4936-bad4-5fc663c5fc01 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.028402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951453b-a765-4936-bad4-5fc663c5fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.028687 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951453b-a765-4936-bad4-5fc663c5fc01 admin admin] PATH_INFO: `/v3/projects/337321d8fb89444fb6a2d364594f9df3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.029768 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 59/112] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:24 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:25.029990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951453b-a765-4936-bad4-5fc663c5fc01 admin admin] RBAC: Authorizing `identity:get_project(project_id=337321d8fb89444fb6a2d364594f9df3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:25.031790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c102da-827f-49f5-b911-0ae7bc868a66 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.032198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951453b-a765-4936-bad4-5fc663c5fc01 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:25.032449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c102da-827f-49f5-b911-0ae7bc868a66 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.032898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c102da-827f-49f5-b911-0ae7bc868a66 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.034955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 60/114] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:25.038828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 54/114] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:24 2022] GET /identity/v3/projects/337321d8fb89444fb6a2d364594f9df3 => generated 313 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:25.040618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298db59-7e9e-4e73-b0aa-23b758d9d21a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.041010 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298db59-7e9e-4e73-b0aa-23b758d9d21a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.041360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298db59-7e9e-4e73-b0aa-23b758d9d21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.041669 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951453b-a765-4936-bad4-5fc663c5fc01 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:25.068256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951453b-a765-4936-bad4-5fc663c5fc01 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:25.080357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-c298db59-7e9e-4e73-b0aa-23b758d9d21a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:25.081809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c298db59-7e9e-4e73-b0aa-23b758d9d21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:25.091429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f4991-07d2-4f89-817e-1a307195394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:25.093121 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f4991-07d2-4f89-817e-1a307195394d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.093787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f4991-07d2-4f89-817e-1a307195394d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.094460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f4991-07d2-4f89-817e-1a307195394d admin admin] PATH_INFO: `/v3/users/be71d63e60ba4d298e036a36c092685f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.099594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f4991-07d2-4f89-817e-1a307195394d admin admin] RBAC: Authorizing `identity:get_user(user_id=be71d63e60ba4d298e036a36c092685f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:25.102117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f4991-07d2-4f89-817e-1a307195394d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:25.105026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 55/115] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:25 2022] GET /identity/v3/users/be71d63e60ba4d298e036a36c092685f => generated 276 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:25.107575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f4991-07d2-4f89-817e-1a307195394d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:25.113544 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 61/116] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:25 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:25.115515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298db59-7e9e-4e73-b0aa-23b758d9d21a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:25.129090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f4991-07d2-4f89-817e-1a307195394d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:25.140678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298db59-7e9e-4e73-b0aa-23b758d9d21a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:25.144515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac419b03-91fa-482f-bffa-32304ad79c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:25.146593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419b03-91fa-482f-bffa-32304ad79c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.148025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419b03-91fa-482f-bffa-32304ad79c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.148794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419b03-91fa-482f-bffa-32304ad79c02 admin admin] PATH_INFO: `/v3/projects/337321d8fb89444fb6a2d364594f9df3/users/be71d63e60ba4d298e036a36c092685f/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.156051 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8537cb7-14eb-4edd-b378-967a33eec85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:25.157508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8537cb7-14eb-4edd-b378-967a33eec85f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.157983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac419b03-91fa-482f-bffa-32304ad79c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337321d8fb89444fb6a2d364594f9df3, user_id=be71d63e60ba4d298e036a36c092685f, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:25.158233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8537cb7-14eb-4edd-b378-967a33eec85f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.159123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8537cb7-14eb-4edd-b378-967a33eec85f admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.160636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8537cb7-14eb-4edd-b378-967a33eec85f admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:25.160837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac419b03-91fa-482f-bffa-32304ad79c02 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:25.163278 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8537cb7-14eb-4edd-b378-967a33eec85f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:25.165216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 62/117] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:25 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:25.166187 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8537cb7-14eb-4edd-b378-967a33eec85f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:25.177914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8537cb7-14eb-4edd-b378-967a33eec85f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:25.185028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd55f5-2079-4434-a5c5-f7f3adbaa4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:25.186158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd55f5-2079-4434-a5c5-f7f3adbaa4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.186643 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd55f5-2079-4434-a5c5-f7f3adbaa4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.187215 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd55f5-2079-4434-a5c5-f7f3adbaa4e5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.202885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 56/118] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:37:25 2022] PUT /identity/v3/projects/337321d8fb89444fb6a2d364594f9df3/users/be71d63e60ba4d298e036a36c092685f/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:37:25.202885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac419b03-91fa-482f-bffa-32304ad79c02 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:25.204947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd55f5-2079-4434-a5c5-f7f3adbaa4e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:25.213292 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-86fd55f5-2079-4434-a5c5-f7f3adbaa4e5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:25.215400 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 63/119] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:25.221317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd55f5-2079-4434-a5c5-f7f3adbaa4e5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:25.234702 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd55f5-2079-4434-a5c5-f7f3adbaa4e5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:25.335578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ad0f-cb6a-46aa-b4d5-2100593026e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:25.336252 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ad0f-cb6a-46aa-b4d5-2100593026e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.336538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ad0f-cb6a-46aa-b4d5-2100593026e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.336813 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ad0f-cb6a-46aa-b4d5-2100593026e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.337585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ad0f-cb6a-46aa-b4d5-2100593026e3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:25.337891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ad0f-cb6a-46aa-b4d5-2100593026e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:25.339707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ad0f-cb6a-46aa-b4d5-2100593026e3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:25.356102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 64/120] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:25 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:25.361511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ad0f-cb6a-46aa-b4d5-2100593026e3 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:25.362544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac419b03-91fa-482f-bffa-32304ad79c02 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:25.376515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0f213-ccd5-4973-868a-3b49f72bcc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:25.377453 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f213-ccd5-4973-868a-3b49f72bcc7a admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.377733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f213-ccd5-4973-868a-3b49f72bcc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.378025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f213-ccd5-4973-868a-3b49f72bcc7a admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/users/be71d63e60ba4d298e036a36c092685f/roles/2d582daf740f43a8bd4b4471a3c1a99a` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.379197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ad0f-cb6a-46aa-b4d5-2100593026e3 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:25.381405 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0f213-ccd5-4973-868a-3b49f72bcc7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3035a30a67154f908dd0a8d0bd3d5b2b, user_id=be71d63e60ba4d298e036a36c092685f, role_id=2d582daf740f43a8bd4b4471a3c1a99a)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:25.383339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0f213-ccd5-4973-868a-3b49f72bcc7a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:25.397624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dfff4-ba2e-4fd7-890b-c488e3b26a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:25.399103 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dfff4-ba2e-4fd7-890b-c488e3b26a55 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.399547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dfff4-ba2e-4fd7-890b-c488e3b26a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.399999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dfff4-ba2e-4fd7-890b-c488e3b26a55 admin admin] PATH_INFO: `/v3/users/be71d63e60ba4d298e036a36c092685f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.403274 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dfff4-ba2e-4fd7-890b-c488e3b26a55 admin admin] RBAC: Authorizing `identity:get_user(user_id=be71d63e60ba4d298e036a36c092685f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:25.405768 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dfff4-ba2e-4fd7-890b-c488e3b26a55 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:25.407967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 65/121] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:25 2022] GET /identity/v3/users/be71d63e60ba4d298e036a36c092685f => generated 276 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:25.414071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dfff4-ba2e-4fd7-890b-c488e3b26a55 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:25.417670 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 57/122] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:37:25 2022] PUT /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/users/be71d63e60ba4d298e036a36c092685f/roles/2d582daf740f43a8bd4b4471a3c1a99a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:37:25.437123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dfff4-ba2e-4fd7-890b-c488e3b26a55 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:25.512100 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad33953-9bf4-44bf-ae01-f7a0f1cba333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:25.513395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad33953-9bf4-44bf-ae01-f7a0f1cba333 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.513972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad33953-9bf4-44bf-ae01-f7a0f1cba333 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.514470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad33953-9bf4-44bf-ae01-f7a0f1cba333 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.516112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad33953-9bf4-44bf-ae01-f7a0f1cba333 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:25.518608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad33953-9bf4-44bf-ae01-f7a0f1cba333 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:25.520713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 66/123] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:25 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:25.527173 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0f213-ccd5-4973-868a-3b49f72bcc7a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:25.548562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0f213-ccd5-4973-868a-3b49f72bcc7a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:25.554105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8801a-87a4-4638-95f2-b57a74dc5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:25.555078 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8801a-87a4-4638-95f2-b57a74dc5150 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.555372 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8801a-87a4-4638-95f2-b57a74dc5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.555653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8801a-87a4-4638-95f2-b57a74dc5150 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/users/be71d63e60ba4d298e036a36c092685f/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.557975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8801a-87a4-4638-95f2-b57a74dc5150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3035a30a67154f908dd0a8d0bd3d5b2b, user_id=be71d63e60ba4d298e036a36c092685f, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:25.561916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8801a-87a4-4638-95f2-b57a74dc5150 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:25.581568 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 58/124] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:37:25 2022] PUT /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/users/be71d63e60ba4d298e036a36c092685f/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:37:25.946324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a141-e9d1-4e93-a1de-d94b3262ccc6 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.946811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a141-e9d1-4e93-a1de-d94b3262ccc6 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.947207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a141-e9d1-4e93-a1de-d94b3262ccc6 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.949803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 67/125] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:25.955473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fb958-ea0d-4b24-8024-1d7beda454b7 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:25.955939 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fb958-ea0d-4b24-8024-1d7beda454b7 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:25.956371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fb958-ea0d-4b24-8024-1d7beda454b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:25.976492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-dd7fb958-ea0d-4b24-8024-1d7beda454b7 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:25.977955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dd7fb958-ea0d-4b24-8024-1d7beda454b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:26.043340 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 59/126] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:25 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:26.068335 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5a141-e9d1-4e93-a1de-d94b3262ccc6 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:26.081317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5a141-e9d1-4e93-a1de-d94b3262ccc6 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:26.085996 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f365341-0d5f-4e67-a3cf-f7c71e07d32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:26.086963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f365341-0d5f-4e67-a3cf-f7c71e07d32a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:26.087446 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f365341-0d5f-4e67-a3cf-f7c71e07d32a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:26.087868 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f365341-0d5f-4e67-a3cf-f7c71e07d32a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:26.089825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f365341-0d5f-4e67-a3cf-f7c71e07d32a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:26.091745 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f365341-0d5f-4e67-a3cf-f7c71e07d32a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:26.093563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 68/127] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:26 2022] GET /identity/v3/domains/default => generated 200 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:26.109177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fb958-ea0d-4b24-8024-1d7beda454b7 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:26.118792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fb958-ea0d-4b24-8024-1d7beda454b7 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:26.126941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26994336-7f91-498e-8454-dda9a3b46a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:26.127831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994336-7f91-498e-8454-dda9a3b46a7d admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:26.128260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994336-7f91-498e-8454-dda9a3b46a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:26.128712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994336-7f91-498e-8454-dda9a3b46a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:26.129581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26994336-7f91-498e-8454-dda9a3b46a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:26.132275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26994336-7f91-498e-8454-dda9a3b46a7d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:26.178243 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 60/128] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:37:26 2022] POST /identity/v3/projects => generated 303 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:26.370741 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b47c6e-7eac-489f-a112-0668b8cd26da None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:26.371862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b47c6e-7eac-489f-a112-0668b8cd26da None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:26.372350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b47c6e-7eac-489f-a112-0668b8cd26da None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:26.374391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 69/129] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:26 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:26.380302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60f764-1975-4c78-9ae4-d122dcbf0ad4 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:26.380592 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60f764-1975-4c78-9ae4-d122dcbf0ad4 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:26.380872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60f764-1975-4c78-9ae4-d122dcbf0ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:26.407785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-aa60f764-1975-4c78-9ae4-d122dcbf0ad4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:26.408980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-aa60f764-1975-4c78-9ae4-d122dcbf0ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:26.489313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 61/130] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:26 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:26.524116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b47c6e-7eac-489f-a112-0668b8cd26da None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:26.539766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b47c6e-7eac-489f-a112-0668b8cd26da None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:26.546042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e5c9f-5cd2-472e-b66b-9a2aa472c39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:26.547167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5c9f-5cd2-472e-b66b-9a2aa472c39a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:26.547654 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5c9f-5cd2-472e-b66b-9a2aa472c39a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:26.548146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5c9f-5cd2-472e-b66b-9a2aa472c39a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:26.567389 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e5c9f-5cd2-472e-b66b-9a2aa472c39a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:26.575651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-e66e5c9f-5cd2-472e-b66b-9a2aa472c39a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 24 16:37:26.577246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 70/131] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:26.583100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60f764-1975-4c78-9ae4-d122dcbf0ad4 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:26.595848 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60f764-1975-4c78-9ae4-d122dcbf0ad4 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:26.602829 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07e579-69f6-4c1b-a5e2-e9bffaf10815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:26.603496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e579-69f6-4c1b-a5e2-e9bffaf10815 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:26.603780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e579-69f6-4c1b-a5e2-e9bffaf10815 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:26.604111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e579-69f6-4c1b-a5e2-e9bffaf10815 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:26.605239 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07e579-69f6-4c1b-a5e2-e9bffaf10815 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:26.605554 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07e579-69f6-4c1b-a5e2-e9bffaf10815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:26.607222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07e579-69f6-4c1b-a5e2-e9bffaf10815 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:26.622295 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 62/132] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:26 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:26.627782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e5c9f-5cd2-472e-b66b-9a2aa472c39a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:26.640438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e5c9f-5cd2-472e-b66b-9a2aa472c39a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:26.647381 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f692dc3-a8cd-4874-8c2b-810d2560ace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:26.648519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692dc3-a8cd-4874-8c2b-810d2560ace6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:26.649038 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692dc3-a8cd-4874-8c2b-810d2560ace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:26.649530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692dc3-a8cd-4874-8c2b-810d2560ace6 admin admin] PATH_INFO: `/v3/users/8e1de38dc4c546129019277bbd8dfc5a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:26.671050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f692dc3-a8cd-4874-8c2b-810d2560ace6 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e1de38dc4c546129019277bbd8dfc5a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:26.673697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f692dc3-a8cd-4874-8c2b-810d2560ace6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:26.675697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 71/133] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:26 2022] GET /identity/v3/users/8e1de38dc4c546129019277bbd8dfc5a => generated 290 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:26.681301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07e579-69f6-4c1b-a5e2-e9bffaf10815 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:26.696232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07e579-69f6-4c1b-a5e2-e9bffaf10815 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:26.707211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fe791-7e6e-4870-ad8a-882581e777a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:26.707872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe791-7e6e-4870-ad8a-882581e777a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:26.708154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe791-7e6e-4870-ad8a-882581e777a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:26.708433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe791-7e6e-4870-ad8a-882581e777a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:26.726456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fe791-7e6e-4870-ad8a-882581e777a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:26.728270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fe791-7e6e-4870-ad8a-882581e777a9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:26.744300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 63/134] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:26 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:26.749755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f692dc3-a8cd-4874-8c2b-810d2560ace6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:26.775136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f692dc3-a8cd-4874-8c2b-810d2560ace6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:26.791522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494bdd7-8d01-472c-92dd-87e85e209739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:26.793144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494bdd7-8d01-472c-92dd-87e85e209739 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:26.793438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494bdd7-8d01-472c-92dd-87e85e209739 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:26.793724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494bdd7-8d01-472c-92dd-87e85e209739 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:26.795045 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494bdd7-8d01-472c-92dd-87e85e209739 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:26.797290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494bdd7-8d01-472c-92dd-87e85e209739 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:26.799172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 72/135] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:26 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:26.807344 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fe791-7e6e-4870-ad8a-882581e777a9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:26.824245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fe791-7e6e-4870-ad8a-882581e777a9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:26.835515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eeba7d-9cd1-4567-80e4-1d67b0aafaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:26.836166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeba7d-9cd1-4567-80e4-1d67b0aafaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:26.836448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeba7d-9cd1-4567-80e4-1d67b0aafaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:26.836725 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeba7d-9cd1-4567-80e4-1d67b0aafaa6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:26.837782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eeba7d-9cd1-4567-80e4-1d67b0aafaa6 admin admin] RBAC: Adding query filter params (role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b, user.id=8e1de38dc4c546129019277bbd8dfc5a) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:26.838094 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eeba7d-9cd1-4567-80e4-1d67b0aafaa6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:26.840823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eeba7d-9cd1-4567-80e4-1d67b0aafaa6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:26.851391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 64/136] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:26 2022] GET /identity/v3/role_assignments?user.id=8e1de38dc4c546129019277bbd8dfc5a&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5 => generated 260 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:28.102698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0537-9dc0-4ff2-af54-004d12f5ccc1 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.103224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0537-9dc0-4ff2-af54-004d12f5ccc1 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.103325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0537-9dc0-4ff2-af54-004d12f5ccc1 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.105714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 73/137] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:28.110970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec84c9-3064-4013-93f8-74ca65d61311 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.111520 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec84c9-3064-4013-93f8-74ca65d61311 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.111520 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec84c9-3064-4013-93f8-74ca65d61311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.134299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-96ec84c9-3064-4013-93f8-74ca65d61311 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:28.136080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-96ec84c9-3064-4013-93f8-74ca65d61311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:28.149143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 65/138] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:28 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:28.193044 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0537-9dc0-4ff2-af54-004d12f5ccc1 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.214259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0537-9dc0-4ff2-af54-004d12f5ccc1 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.222505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377f187-855b-4616-a43c-b98560bfad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.223323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377f187-855b-4616-a43c-b98560bfad7d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.223610 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377f187-855b-4616-a43c-b98560bfad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.223892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377f187-855b-4616-a43c-b98560bfad7d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.241013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377f187-855b-4616-a43c-b98560bfad7d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:28.248793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-6377f187-855b-4616-a43c-b98560bfad7d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:28.250317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 74/139] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:28.256087 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec84c9-3064-4013-93f8-74ca65d61311 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.266518 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec84c9-3064-4013-93f8-74ca65d61311 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.276027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4a3bf-bf5a-4489-b8f3-bd9b541dfa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.276681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4a3bf-bf5a-4489-b8f3-bd9b541dfa0c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.276968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4a3bf-bf5a-4489-b8f3-bd9b541dfa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.277247 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4a3bf-bf5a-4489-b8f3-bd9b541dfa0c admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.278038 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4a3bf-bf5a-4489-b8f3-bd9b541dfa0c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:28.278348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4a3bf-bf5a-4489-b8f3-bd9b541dfa0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.280021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4a3bf-bf5a-4489-b8f3-bd9b541dfa0c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.290270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 66/140] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:28.296121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377f187-855b-4616-a43c-b98560bfad7d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.313059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377f187-855b-4616-a43c-b98560bfad7d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.320711 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760ca7d-33a5-461a-9271-01802106e8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.321592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760ca7d-33a5-461a-9271-01802106e8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.321884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760ca7d-33a5-461a-9271-01802106e8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.322166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760ca7d-33a5-461a-9271-01802106e8b5 admin admin] PATH_INFO: `/v3/users/e3931bcf4ae942f8ab85de758142ef39` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.324236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760ca7d-33a5-461a-9271-01802106e8b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3931bcf4ae942f8ab85de758142ef39)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.326191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760ca7d-33a5-461a-9271-01802106e8b5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.328192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 75/141] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/users/e3931bcf4ae942f8ab85de758142ef39 => generated 248 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:28.333519 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4a3bf-bf5a-4489-b8f3-bd9b541dfa0c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.343764 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4a3bf-bf5a-4489-b8f3-bd9b541dfa0c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.350741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee732416-988c-4b21-8749-a2bf0d01e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.351412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee732416-988c-4b21-8749-a2bf0d01e240 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.351700 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee732416-988c-4b21-8749-a2bf0d01e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.351978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee732416-988c-4b21-8749-a2bf0d01e240 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.360958 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee732416-988c-4b21-8749-a2bf0d01e240 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.362677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee732416-988c-4b21-8749-a2bf0d01e240 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.372665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 67/142] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:28.378287 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760ca7d-33a5-461a-9271-01802106e8b5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.388974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760ca7d-33a5-461a-9271-01802106e8b5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.398838 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4136264-c1fb-4c8d-875c-4a51a2b4f456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.399894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4136264-c1fb-4c8d-875c-4a51a2b4f456 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.400324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4136264-c1fb-4c8d-875c-4a51a2b4f456 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.400863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4136264-c1fb-4c8d-875c-4a51a2b4f456 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.402288 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4136264-c1fb-4c8d-875c-4a51a2b4f456 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.404530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4136264-c1fb-4c8d-875c-4a51a2b4f456 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.406362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 76/143] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:28.412314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee732416-988c-4b21-8749-a2bf0d01e240 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.421963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee732416-988c-4b21-8749-a2bf0d01e240 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.430917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f69f44-23b1-4079-96de-563bb32d333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.431740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f69f44-23b1-4079-96de-563bb32d333a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.433110 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f69f44-23b1-4079-96de-563bb32d333a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.433549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f69f44-23b1-4079-96de-563bb32d333a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.434550 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f69f44-23b1-4079-96de-563bb32d333a admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b, user.id=e3931bcf4ae942f8ab85de758142ef39) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:28.435051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f69f44-23b1-4079-96de-563bb32d333a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.437074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f69f44-23b1-4079-96de-563bb32d333a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.443728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 68/144] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/role_assignments?user.id=e3931bcf4ae942f8ab85de758142ef39&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 610 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:28.452040 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd39f-5d71-403e-a8c2-8c43bfe91ecd None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.452547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd39f-5d71-403e-a8c2-8c43bfe91ecd None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.452970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd39f-5d71-403e-a8c2-8c43bfe91ecd None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.455036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 77/145] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:28.461124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5114d-a5fe-4b06-921a-f4372c0d65a6 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.461609 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5114d-a5fe-4b06-921a-f4372c0d65a6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.462035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5114d-a5fe-4b06-921a-f4372c0d65a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.491845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ccb5114d-a5fe-4b06-921a-f4372c0d65a6 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:28.493331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ccb5114d-a5fe-4b06-921a-f4372c0d65a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:28.502132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 69/146] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:28 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:28.540263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd39f-5d71-403e-a8c2-8c43bfe91ecd None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.554003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd39f-5d71-403e-a8c2-8c43bfe91ecd None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.562851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97761d5-f726-458f-9469-78a0accdc86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.563996 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97761d5-f726-458f-9469-78a0accdc86b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.564428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97761d5-f726-458f-9469-78a0accdc86b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.564833 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97761d5-f726-458f-9469-78a0accdc86b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.581775 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97761d5-f726-458f-9469-78a0accdc86b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:28.590340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-e97761d5-f726-458f-9469-78a0accdc86b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:28.592245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 78/147] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:28.598461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5114d-a5fe-4b06-921a-f4372c0d65a6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.609114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5114d-a5fe-4b06-921a-f4372c0d65a6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.616535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eae89c-01c7-4059-814f-32c596e77a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.617141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eae89c-01c7-4059-814f-32c596e77a21 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.617427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eae89c-01c7-4059-814f-32c596e77a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.617701 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eae89c-01c7-4059-814f-32c596e77a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.618481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eae89c-01c7-4059-814f-32c596e77a21 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:28.618801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eae89c-01c7-4059-814f-32c596e77a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.620482 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eae89c-01c7-4059-814f-32c596e77a21 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.633560 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 70/148] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:28.640320 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97761d5-f726-458f-9469-78a0accdc86b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.656859 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97761d5-f726-458f-9469-78a0accdc86b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.667569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a917a2-71ff-461c-877f-b1be98b5172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.668878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a917a2-71ff-461c-877f-b1be98b5172a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.669343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a917a2-71ff-461c-877f-b1be98b5172a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.669794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a917a2-71ff-461c-877f-b1be98b5172a admin admin] PATH_INFO: `/v3/users/be71d63e60ba4d298e036a36c092685f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.671347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a917a2-71ff-461c-877f-b1be98b5172a admin admin] RBAC: Authorizing `identity:get_user(user_id=be71d63e60ba4d298e036a36c092685f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.673699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a917a2-71ff-461c-877f-b1be98b5172a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.675881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 79/149] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/users/be71d63e60ba4d298e036a36c092685f => generated 276 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:28.678462 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4df45-695c-461e-ae7a-4b8d27337a44 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.678774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4df45-695c-461e-ae7a-4b8d27337a44 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.679055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4df45-695c-461e-ae7a-4b8d27337a44 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.680835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 71/150] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:28.681402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a917a2-71ff-461c-877f-b1be98b5172a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.692291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60767f5f-383f-4cd4-baca-686113e35531 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.692576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60767f5f-383f-4cd4-baca-686113e35531 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.692856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60767f5f-383f-4cd4-baca-686113e35531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.697026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a917a2-71ff-461c-877f-b1be98b5172a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.714479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa09fc7-8613-426f-a5bf-14edafc3537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.715568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa09fc7-8613-426f-a5bf-14edafc3537a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.716092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa09fc7-8613-426f-a5bf-14edafc3537a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.716562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa09fc7-8613-426f-a5bf-14edafc3537a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.731373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa09fc7-8613-426f-a5bf-14edafc3537a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.733217 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa09fc7-8613-426f-a5bf-14edafc3537a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.739897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-60767f5f-383f-4cd4-baca-686113e35531 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:28.741112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-60767f5f-383f-4cd4-baca-686113e35531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:28.746947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 80/151] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:37:28.749305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa09fc7-8613-426f-a5bf-14edafc3537a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.758513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa09fc7-8613-426f-a5bf-14edafc3537a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.763842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 72/152] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:28 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Jan 24 16:37:28.772954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819164a8-090f-4a50-bd8d-ffefdb57b563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.773814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819164a8-090f-4a50-bd8d-ffefdb57b563 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.774097 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819164a8-090f-4a50-bd8d-ffefdb57b563 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.774374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819164a8-090f-4a50-bd8d-ffefdb57b563 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.776552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819164a8-090f-4a50-bd8d-ffefdb57b563 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.778624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819164a8-090f-4a50-bd8d-ffefdb57b563 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.780443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 81/153] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:28.786391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60767f5f-383f-4cd4-baca-686113e35531 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.796584 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60767f5f-383f-4cd4-baca-686113e35531 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.800505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819164a8-090f-4a50-bd8d-ffefdb57b563 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.812441 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819164a8-090f-4a50-bd8d-ffefdb57b563 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.814173 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92208d99-07c1-48e8-a686-8034a190b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.814861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208d99-07c1-48e8-a686-8034a190b837 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.815152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208d99-07c1-48e8-a686-8034a190b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.815435 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208d99-07c1-48e8-a686-8034a190b837 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.816296 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92208d99-07c1-48e8-a686-8034a190b837 admin admin] RBAC: Adding query filter params (role.id=2d582daf740f43a8bd4b4471a3c1a99a, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b, user.id=be71d63e60ba4d298e036a36c092685f) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:28.816611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92208d99-07c1-48e8-a686-8034a190b837 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.818483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92208d99-07c1-48e8-a686-8034a190b837 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.829143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 73/154] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/role_assignments?user.id=be71d63e60ba4d298e036a36c092685f&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=2d582daf740f43a8bd4b4471a3c1a99a => generated 610 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:28.835426 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f8c16-6f6f-4067-be64-5fc0c8325a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.836248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f8c16-6f6f-4067-be64-5fc0c8325a02 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.836534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f8c16-6f6f-4067-be64-5fc0c8325a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.836810 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f8c16-6f6f-4067-be64-5fc0c8325a02 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.853029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f8c16-6f6f-4067-be64-5fc0c8325a02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:28.860870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-306f8c16-6f6f-4067-be64-5fc0c8325a02 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:28.862387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 82/155] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:37:28.868758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92208d99-07c1-48e8-a686-8034a190b837 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.884302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92208d99-07c1-48e8-a686-8034a190b837 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.892477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054b3e0-4649-459a-91ab-443e91d755b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.893161 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b3e0-4649-459a-91ab-443e91d755b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.893446 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b3e0-4649-459a-91ab-443e91d755b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.893724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b3e0-4649-459a-91ab-443e91d755b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.894507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054b3e0-4649-459a-91ab-443e91d755b8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:28.894847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054b3e0-4649-459a-91ab-443e91d755b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.896475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054b3e0-4649-459a-91ab-443e91d755b8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.910302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 74/156] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:28.916301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f8c16-6f6f-4067-be64-5fc0c8325a02 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.926329 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f8c16-6f6f-4067-be64-5fc0c8325a02 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.935596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb46c9-0b90-412b-be53-d1e1e4475160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.936472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb46c9-0b90-412b-be53-d1e1e4475160 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.936753 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb46c9-0b90-412b-be53-d1e1e4475160 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.937031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb46c9-0b90-412b-be53-d1e1e4475160 admin admin] PATH_INFO: `/v3/users/be71d63e60ba4d298e036a36c092685f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.938278 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb46c9-0b90-412b-be53-d1e1e4475160 admin admin] RBAC: Authorizing `identity:get_user(user_id=be71d63e60ba4d298e036a36c092685f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.940492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb46c9-0b90-412b-be53-d1e1e4475160 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:28.942111 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 83/157] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/users/be71d63e60ba4d298e036a36c092685f => generated 276 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:28.948146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054b3e0-4649-459a-91ab-443e91d755b8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:28.962966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054b3e0-4649-459a-91ab-443e91d755b8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:28.968820 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07eb50-4732-4ac2-b714-6b76ecbfa580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:28.969470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07eb50-4732-4ac2-b714-6b76ecbfa580 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:28.969758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07eb50-4732-4ac2-b714-6b76ecbfa580 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:28.970041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07eb50-4732-4ac2-b714-6b76ecbfa580 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:28.983700 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07eb50-4732-4ac2-b714-6b76ecbfa580 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:28.985512 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07eb50-4732-4ac2-b714-6b76ecbfa580 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:29.001594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 75/158] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:28 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:37:29.007646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb46c9-0b90-412b-be53-d1e1e4475160 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:29.021221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb46c9-0b90-412b-be53-d1e1e4475160 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:29.037676 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac01cb-d921-43c5-bbd6-bbe1adca71d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:29.038546 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac01cb-d921-43c5-bbd6-bbe1adca71d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.038848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac01cb-d921-43c5-bbd6-bbe1adca71d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.039168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac01cb-d921-43c5-bbd6-bbe1adca71d4 admin admin] PATH_INFO: `/v3/projects/337321d8fb89444fb6a2d364594f9df3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.040639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac01cb-d921-43c5-bbd6-bbe1adca71d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=337321d8fb89444fb6a2d364594f9df3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:29.042866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac01cb-d921-43c5-bbd6-bbe1adca71d4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:29.044790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 84/159] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:29 2022] GET /identity/v3/projects/337321d8fb89444fb6a2d364594f9df3 => generated 313 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:29.050931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07eb50-4732-4ac2-b714-6b76ecbfa580 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:29.063323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07eb50-4732-4ac2-b714-6b76ecbfa580 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:29.068905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ed63b-79aa-4d38-8e56-9d7bf41e27d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:29.069680 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed63b-79aa-4d38-8e56-9d7bf41e27d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.069961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed63b-79aa-4d38-8e56-9d7bf41e27d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.070289 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed63b-79aa-4d38-8e56-9d7bf41e27d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.071192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ed63b-79aa-4d38-8e56-9d7bf41e27d9 admin admin] RBAC: Adding query filter params (role.id=42656495a54b4164862c9a31838a731e, scope.project.id=337321d8fb89444fb6a2d364594f9df3, user.id=be71d63e60ba4d298e036a36c092685f) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:29.071557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ed63b-79aa-4d38-8e56-9d7bf41e27d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:29.073665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ed63b-79aa-4d38-8e56-9d7bf41e27d9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:29.086486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 76/160] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:29 2022] GET /identity/v3/role_assignments?user.id=be71d63e60ba4d298e036a36c092685f&scope.project.id=337321d8fb89444fb6a2d364594f9df3&role.id=42656495a54b4164862c9a31838a731e => generated 610 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:29.187602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588df9f-3862-48cc-aba4-89ef4be91e2a None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.188220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588df9f-3862-48cc-aba4-89ef4be91e2a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.188220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588df9f-3862-48cc-aba4-89ef4be91e2a None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.190052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 85/161] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:29.195798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf542d3-7743-42bb-ae4d-7fef7583f7e0 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.196411 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf542d3-7743-42bb-ae4d-7fef7583f7e0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.196411 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf542d3-7743-42bb-ae4d-7fef7583f7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.220798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-8bf542d3-7743-42bb-ae4d-7fef7583f7e0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:29.222094 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8bf542d3-7743-42bb-ae4d-7fef7583f7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:29.231024 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 77/162] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:29 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:29.258101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588df9f-3862-48cc-aba4-89ef4be91e2a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:29.280689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588df9f-3862-48cc-aba4-89ef4be91e2a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:29.287525 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5803ab-7317-4066-ab28-a9f5851af76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:29.288330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5803ab-7317-4066-ab28-a9f5851af76c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.288658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5803ab-7317-4066-ab28-a9f5851af76c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.288971 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5803ab-7317-4066-ab28-a9f5851af76c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.306149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5803ab-7317-4066-ab28-a9f5851af76c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:29.314144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-bb5803ab-7317-4066-ab28-a9f5851af76c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:29.317244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 86/163] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:29.323777 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf542d3-7743-42bb-ae4d-7fef7583f7e0 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:29.333570 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf542d3-7743-42bb-ae4d-7fef7583f7e0 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:29.341242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b85b59-e88e-4563-94d5-02b225c96cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:29.341917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85b59-e88e-4563-94d5-02b225c96cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.342257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85b59-e88e-4563-94d5-02b225c96cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.342539 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85b59-e88e-4563-94d5-02b225c96cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.343433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b85b59-e88e-4563-94d5-02b225c96cf1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:29.343739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b85b59-e88e-4563-94d5-02b225c96cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:29.345471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b85b59-e88e-4563-94d5-02b225c96cf1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:29.356306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 78/164] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:29 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:29.362166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5803ab-7317-4066-ab28-a9f5851af76c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:29.372936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5803ab-7317-4066-ab28-a9f5851af76c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:29.377419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b4f1e-7858-4d88-af32-8e18a094ea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:29.378279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b4f1e-7858-4d88-af32-8e18a094ea72 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.378561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b4f1e-7858-4d88-af32-8e18a094ea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.378863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b4f1e-7858-4d88-af32-8e18a094ea72 admin admin] PATH_INFO: `/v3/users/be71d63e60ba4d298e036a36c092685f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.380098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b4f1e-7858-4d88-af32-8e18a094ea72 admin admin] RBAC: Authorizing `identity:get_user(user_id=be71d63e60ba4d298e036a36c092685f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:29.382262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b4f1e-7858-4d88-af32-8e18a094ea72 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:29.384091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 87/165] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:29 2022] GET /identity/v3/users/be71d63e60ba4d298e036a36c092685f => generated 276 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:29.389513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b85b59-e88e-4563-94d5-02b225c96cf1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:29.399585 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b85b59-e88e-4563-94d5-02b225c96cf1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:29.407338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586be64f-328f-49ef-a837-3e9f1007cebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:29.408006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be64f-328f-49ef-a837-3e9f1007cebc admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.408287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be64f-328f-49ef-a837-3e9f1007cebc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.408566 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be64f-328f-49ef-a837-3e9f1007cebc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.419680 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586be64f-328f-49ef-a837-3e9f1007cebc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:29.421588 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586be64f-328f-49ef-a837-3e9f1007cebc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:29.433872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 79/166] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:29 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:29.440223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b4f1e-7858-4d88-af32-8e18a094ea72 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:29.451962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b4f1e-7858-4d88-af32-8e18a094ea72 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:29.456580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764bb34-f9c7-4cfe-befa-89e85ebcc103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:29.457752 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764bb34-f9c7-4cfe-befa-89e85ebcc103 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.458244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764bb34-f9c7-4cfe-befa-89e85ebcc103 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.458519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764bb34-f9c7-4cfe-befa-89e85ebcc103 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.459732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764bb34-f9c7-4cfe-befa-89e85ebcc103 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:29.461766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764bb34-f9c7-4cfe-befa-89e85ebcc103 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:29.464045 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 88/167] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:29 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:29.470225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586be64f-328f-49ef-a837-3e9f1007cebc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:29.480090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586be64f-328f-49ef-a837-3e9f1007cebc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:29.484438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53471291-bed2-4fa9-a82f-334e06e0deae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:29.485077 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53471291-bed2-4fa9-a82f-334e06e0deae admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.485358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53471291-bed2-4fa9-a82f-334e06e0deae admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.485628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53471291-bed2-4fa9-a82f-334e06e0deae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.486470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53471291-bed2-4fa9-a82f-334e06e0deae admin admin] RBAC: Adding query filter params (role.id=42656495a54b4164862c9a31838a731e, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b, user.id=be71d63e60ba4d298e036a36c092685f) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:29.486798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53471291-bed2-4fa9-a82f-334e06e0deae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:29.488647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53471291-bed2-4fa9-a82f-334e06e0deae admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:29.494870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 80/168] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:29 2022] GET /identity/v3/role_assignments?user.id=be71d63e60ba4d298e036a36c092685f&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=42656495a54b4164862c9a31838a731e => generated 610 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:29.838886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7c2d1-035c-4f70-8c24-872d0c2ff903 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.839169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7c2d1-035c-4f70-8c24-872d0c2ff903 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.839446 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7c2d1-035c-4f70-8c24-872d0c2ff903 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.841228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 89/169] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:29.846423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ca7f3-afdb-4685-afc6-f05ad34c6a52 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.846812 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ca7f3-afdb-4685-afc6-f05ad34c6a52 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.847160 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ca7f3-afdb-4685-afc6-f05ad34c6a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.864886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-249ca7f3-afdb-4685-afc6-f05ad34c6a52 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:29.866061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-249ca7f3-afdb-4685-afc6-f05ad34c6a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:29.874065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 81/170] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:29 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:29.899056 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7c2d1-035c-4f70-8c24-872d0c2ff903 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:29.911678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7c2d1-035c-4f70-8c24-872d0c2ff903 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:29.915847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90287398-3ee7-4f7e-a914-76a3dd9e6289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:29.917319 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90287398-3ee7-4f7e-a914-76a3dd9e6289 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.917600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90287398-3ee7-4f7e-a914-76a3dd9e6289 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.917878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90287398-3ee7-4f7e-a914-76a3dd9e6289 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.919073 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90287398-3ee7-4f7e-a914-76a3dd9e6289 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:29.920753 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90287398-3ee7-4f7e-a914-76a3dd9e6289 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:29.922476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 90/171] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:29 2022] GET /identity/v3/domains/default => generated 200 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:29.927518 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ca7f3-afdb-4685-afc6-f05ad34c6a52 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:29.936715 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ca7f3-afdb-4685-afc6-f05ad34c6a52 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:29.941276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0781d9-21c1-4ebb-8c30-fbe5ac90b6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:29.941963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0781d9-21c1-4ebb-8c30-fbe5ac90b6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:29.942244 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0781d9-21c1-4ebb-8c30-fbe5ac90b6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:29.942515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0781d9-21c1-4ebb-8c30-fbe5ac90b6d3 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:29.943311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0781d9-21c1-4ebb-8c30-fbe5ac90b6d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:29.945309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0781d9-21c1-4ebb-8c30-fbe5ac90b6d3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:29.967510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 82/172] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:37:29 2022] POST /identity/v3/users => generated 284 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:30.191947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0bbb8-ed4c-4782-a944-554cfe96e95f None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:30.192439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0bbb8-ed4c-4782-a944-554cfe96e95f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:30.192524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0bbb8-ed4c-4782-a944-554cfe96e95f None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:30.194250 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 91/173] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:30.200036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0486-02a9-43bd-875f-623e61deb7f8 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:30.200450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0486-02a9-43bd-875f-623e61deb7f8 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:30.200700 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0486-02a9-43bd-875f-623e61deb7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:30.219289 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e1ec0486-02a9-43bd-875f-623e61deb7f8 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:30.220500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e1ec0486-02a9-43bd-875f-623e61deb7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:30.228188 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 83/174] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:30 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:30.254252 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0bbb8-ed4c-4782-a944-554cfe96e95f None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:30.266967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0bbb8-ed4c-4782-a944-554cfe96e95f None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:30.271266 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68d083-c199-409e-91ab-be0543a14135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:30.272036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68d083-c199-409e-91ab-be0543a14135 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:30.272312 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68d083-c199-409e-91ab-be0543a14135 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:30.272584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68d083-c199-409e-91ab-be0543a14135 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:30.283622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68d083-c199-409e-91ab-be0543a14135 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:30.290838 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-aa68d083-c199-409e-91ab-be0543a14135 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 24 16:37:30.292652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 92/175] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:30.298185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec0486-02a9-43bd-875f-623e61deb7f8 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:30.308034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec0486-02a9-43bd-875f-623e61deb7f8 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:30.312411 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df64ce-4925-4020-94ea-0273ed03fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:30.313065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df64ce-4925-4020-94ea-0273ed03fd72 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:30.313343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df64ce-4925-4020-94ea-0273ed03fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:30.313613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df64ce-4925-4020-94ea-0273ed03fd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:30.314370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df64ce-4925-4020-94ea-0273ed03fd72 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:30.314670 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df64ce-4925-4020-94ea-0273ed03fd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:30.316307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df64ce-4925-4020-94ea-0273ed03fd72 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:30.325356 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 84/176] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:30 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:30.331071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68d083-c199-409e-91ab-be0543a14135 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:30.342035 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68d083-c199-409e-91ab-be0543a14135 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:30.346849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e431e-5fcb-49a5-9269-c49b79ce2a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:30.347729 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e431e-5fcb-49a5-9269-c49b79ce2a25 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:30.348029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e431e-5fcb-49a5-9269-c49b79ce2a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:30.348287 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e431e-5fcb-49a5-9269-c49b79ce2a25 admin admin] PATH_INFO: `/v3/users/8e1de38dc4c546129019277bbd8dfc5a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:30.349523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e431e-5fcb-49a5-9269-c49b79ce2a25 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e1de38dc4c546129019277bbd8dfc5a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:30.351707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e431e-5fcb-49a5-9269-c49b79ce2a25 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:30.353337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 93/177] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:30 2022] GET /identity/v3/users/8e1de38dc4c546129019277bbd8dfc5a => generated 290 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:30.360033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df64ce-4925-4020-94ea-0273ed03fd72 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:30.370579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df64ce-4925-4020-94ea-0273ed03fd72 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:30.375733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cecb9-eb1d-4f67-a471-5c8953ae7d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:30.376578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cecb9-eb1d-4f67-a471-5c8953ae7d03 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:30.376857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cecb9-eb1d-4f67-a471-5c8953ae7d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:30.377126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cecb9-eb1d-4f67-a471-5c8953ae7d03 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:30.378319 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cecb9-eb1d-4f67-a471-5c8953ae7d03 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:30.380409 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cecb9-eb1d-4f67-a471-5c8953ae7d03 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:30.382054 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 85/178] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:30 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:30.388366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e431e-5fcb-49a5-9269-c49b79ce2a25 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:30.399228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e431e-5fcb-49a5-9269-c49b79ce2a25 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:30.404623 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da54159-1d32-4d5d-a7e9-2d718303bac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:30.405533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da54159-1d32-4d5d-a7e9-2d718303bac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:30.405812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da54159-1d32-4d5d-a7e9-2d718303bac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:30.406135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da54159-1d32-4d5d-a7e9-2d718303bac3 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/users/8e1de38dc4c546129019277bbd8dfc5a/roles/80ddcf60ec9a4fe5b64bf40d73fdd3b5` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:30.408277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da54159-1d32-4d5d-a7e9-2d718303bac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3035a30a67154f908dd0a8d0bd3d5b2b, user_id=8e1de38dc4c546129019277bbd8dfc5a, role_id=80ddcf60ec9a4fe5b64bf40d73fdd3b5)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:30.410968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da54159-1d32-4d5d-a7e9-2d718303bac3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:30.426903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 94/179] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:37:30 2022] PUT /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/users/8e1de38dc4c546129019277bbd8dfc5a/roles/80ddcf60ec9a4fe5b64bf40d73fdd3b5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:37:32.299626 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47dc33-5aa9-4e74-a704-88742beefd48 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.300154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47dc33-5aa9-4e74-a704-88742beefd48 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.300154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47dc33-5aa9-4e74-a704-88742beefd48 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.302037 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 86/180] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:32.308102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c09f44-6cba-4e60-93e3-8ea4fb652468 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.308645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c09f44-6cba-4e60-93e3-8ea4fb652468 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.308645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c09f44-6cba-4e60-93e3-8ea4fb652468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.328640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-76c09f44-6cba-4e60-93e3-8ea4fb652468 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:32.329897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-76c09f44-6cba-4e60-93e3-8ea4fb652468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:32.389332 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 95/181] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:32 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:32.413565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47dc33-5aa9-4e74-a704-88742beefd48 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.426504 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47dc33-5aa9-4e74-a704-88742beefd48 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.431017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de7679-8d2f-4626-984a-f85c66ac86af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.432432 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7679-8d2f-4626-984a-f85c66ac86af admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.432720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7679-8d2f-4626-984a-f85c66ac86af admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.432993 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7679-8d2f-4626-984a-f85c66ac86af admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.443578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de7679-8d2f-4626-984a-f85c66ac86af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:32.450466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-d3de7679-8d2f-4626-984a-f85c66ac86af admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:32.451694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 87/182] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:32.457564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b80cae-2e32-457b-961c-c17abcda38b5 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.457857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b80cae-2e32-457b-961c-c17abcda38b5 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.458139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b80cae-2e32-457b-961c-c17abcda38b5 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.459717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de7679-8d2f-4626-984a-f85c66ac86af admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.460392 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 96/183] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:32.465829 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630cb81-7786-4903-8b4e-d7869c57bc9f None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.466119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630cb81-7786-4903-8b4e-d7869c57bc9f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.466402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630cb81-7786-4903-8b4e-d7869c57bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.471307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de7679-8d2f-4626-984a-f85c66ac86af admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.475987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90148105-83c6-411a-b0aa-f3410dbedc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.476963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90148105-83c6-411a-b0aa-f3410dbedc4a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.477462 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90148105-83c6-411a-b0aa-f3410dbedc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.477923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90148105-83c6-411a-b0aa-f3410dbedc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.479772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90148105-83c6-411a-b0aa-f3410dbedc4a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:32.480326 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90148105-83c6-411a-b0aa-f3410dbedc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.482168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90148105-83c6-411a-b0aa-f3410dbedc4a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.486390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-8630cb81-7786-4903-8b4e-d7869c57bc9f None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:32.487663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8630cb81-7786-4903-8b4e-d7869c57bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:32.497134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 88/184] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:32.498458 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90148105-83c6-411a-b0aa-f3410dbedc4a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.504286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 97/185] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:32 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:32.512385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90148105-83c6-411a-b0aa-f3410dbedc4a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.517120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df73ab1-7e69-4394-8ffc-d3bf79141f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.518237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73ab1-7e69-4394-8ffc-d3bf79141f28 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.518740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73ab1-7e69-4394-8ffc-d3bf79141f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.519227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73ab1-7e69-4394-8ffc-d3bf79141f28 admin admin] PATH_INFO: `/v3/users/7257ec05d8424a2d909dd62fae7572b9` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.529331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630cb81-7786-4903-8b4e-d7869c57bc9f None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.537831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df73ab1-7e69-4394-8ffc-d3bf79141f28 admin admin] RBAC: Authorizing `identity:get_user(user_id=7257ec05d8424a2d909dd62fae7572b9)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.539406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630cb81-7786-4903-8b4e-d7869c57bc9f None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.540515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df73ab1-7e69-4394-8ffc-d3bf79141f28 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.542466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 89/186] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/users/7257ec05d8424a2d909dd62fae7572b9 => generated 284 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:32.548254 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df73ab1-7e69-4394-8ffc-d3bf79141f28 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.548990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739a7af-437c-4f34-b67d-5269c849e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.550309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a7af-437c-4f34-b67d-5269c849e019 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.551129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a7af-437c-4f34-b67d-5269c849e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.553739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a7af-437c-4f34-b67d-5269c849e019 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.561273 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df73ab1-7e69-4394-8ffc-d3bf79141f28 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.565802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5c63e-db2c-458f-bf11-1112d9ccb40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.566069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739a7af-437c-4f34-b67d-5269c849e019 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:32.566438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5c63e-db2c-458f-bf11-1112d9ccb40a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.566716 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5c63e-db2c-458f-bf11-1112d9ccb40a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.567024 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5c63e-db2c-458f-bf11-1112d9ccb40a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.574523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-e739a7af-437c-4f34-b67d-5269c849e019 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:32.575888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5c63e-db2c-458f-bf11-1112d9ccb40a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.575993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 98/187] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:37:32.577502 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5c63e-db2c-458f-bf11-1112d9ccb40a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.580160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eab35f-e29a-42f8-811d-c5602097d450 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.580665 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eab35f-e29a-42f8-811d-c5602097d450 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.580947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eab35f-e29a-42f8-811d-c5602097d450 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.583588 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 99/188] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:32.584477 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eab35f-e29a-42f8-811d-c5602097d450 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.586521 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 90/189] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:37:32.591328 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175e71-aa44-49d6-90d6-8b2f5cb11315 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.591831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175e71-aa44-49d6-90d6-8b2f5cb11315 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.592306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175e71-aa44-49d6-90d6-8b2f5cb11315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.602061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eab35f-e29a-42f8-811d-c5602097d450 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.606964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00839ddb-43e6-419f-849f-2efe8f2e5d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.607604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00839ddb-43e6-419f-849f-2efe8f2e5d17 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.607890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00839ddb-43e6-419f-849f-2efe8f2e5d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.608167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00839ddb-43e6-419f-849f-2efe8f2e5d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.608931 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00839ddb-43e6-419f-849f-2efe8f2e5d17 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:32.609237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00839ddb-43e6-419f-849f-2efe8f2e5d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.610860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00839ddb-43e6-419f-849f-2efe8f2e5d17 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.611699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b3175e71-aa44-49d6-90d6-8b2f5cb11315 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:32.613135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b3175e71-aa44-49d6-90d6-8b2f5cb11315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:32.619794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 100/190] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:32.620576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00839ddb-43e6-419f-849f-2efe8f2e5d17 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.622291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 91/191] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:32 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:32.630799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3175e71-aa44-49d6-90d6-8b2f5cb11315 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.630928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00839ddb-43e6-419f-849f-2efe8f2e5d17 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.638466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e79236-ed45-434c-8aa6-3617062a12c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.639541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e79236-ed45-434c-8aa6-3617062a12c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.639960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e79236-ed45-434c-8aa6-3617062a12c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.640369 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e79236-ed45-434c-8aa6-3617062a12c7 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.641706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e79236-ed45-434c-8aa6-3617062a12c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.642089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3175e71-aa44-49d6-90d6-8b2f5cb11315 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.644200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e79236-ed45-434c-8aa6-3617062a12c7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.646211 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 101/192] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:32.651163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ca405-337b-44c5-8534-6ecab0c5fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.651163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ca405-337b-44c5-8534-6ecab0c5fe49 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.651163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ca405-337b-44c5-8534-6ecab0c5fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.651163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ca405-337b-44c5-8534-6ecab0c5fe49 admin admin] PATH_INFO: `/v3/users/7257ec05d8424a2d909dd62fae7572b9` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.652317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e79236-ed45-434c-8aa6-3617062a12c7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.652500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ca405-337b-44c5-8534-6ecab0c5fe49 admin admin] RBAC: Authorizing `identity:get_user(user_id=7257ec05d8424a2d909dd62fae7572b9)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.654642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ca405-337b-44c5-8534-6ecab0c5fe49 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.656309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 92/193] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/users/7257ec05d8424a2d909dd62fae7572b9 => generated 284 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:32.657057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ca405-337b-44c5-8534-6ecab0c5fe49 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.665714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e79236-ed45-434c-8aa6-3617062a12c7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.667797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ca405-337b-44c5-8534-6ecab0c5fe49 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.670132 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1388e54-4c87-48f4-81eb-811dcf591c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.670943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1388e54-4c87-48f4-81eb-811dcf591c3c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.671212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1388e54-4c87-48f4-81eb-811dcf591c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.671484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1388e54-4c87-48f4-81eb-811dcf591c3c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.672201 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269a8a2-3783-48fa-933a-9f0c115b69ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.672625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1388e54-4c87-48f4-81eb-811dcf591c3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.672834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269a8a2-3783-48fa-933a-9f0c115b69ee admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.673105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269a8a2-3783-48fa-933a-9f0c115b69ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.673391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269a8a2-3783-48fa-933a-9f0c115b69ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.674320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269a8a2-3783-48fa-933a-9f0c115b69ee admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=3a4097a2cc55405b80afdb315dd566fe, user.id=7257ec05d8424a2d909dd62fae7572b9) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:32.674422 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1388e54-4c87-48f4-81eb-811dcf591c3c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.674633 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269a8a2-3783-48fa-933a-9f0c115b69ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.678881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 102/194] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:32.678997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269a8a2-3783-48fa-933a-9f0c115b69ee admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.679069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1388e54-4c87-48f4-81eb-811dcf591c3c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.688323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 93/195] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/role_assignments?user.id=7257ec05d8424a2d909dd62fae7572b9&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:32.688323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269a8a2-3783-48fa-933a-9f0c115b69ee admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.694023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269a8a2-3783-48fa-933a-9f0c115b69ee admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.694857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1388e54-4c87-48f4-81eb-811dcf591c3c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.699627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe56c45-e838-420b-89b8-ab06e94f3b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.700287 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e2aeb-5979-49af-be27-c1216e601368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.700403 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe56c45-e838-420b-89b8-ab06e94f3b8f admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.700685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe56c45-e838-420b-89b8-ab06e94f3b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.700942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e2aeb-5979-49af-be27-c1216e601368 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.701035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe56c45-e838-420b-89b8-ab06e94f3b8f admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.701224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e2aeb-5979-49af-be27-c1216e601368 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.701503 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e2aeb-5979-49af-be27-c1216e601368 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.701849 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe56c45-e838-420b-89b8-ab06e94f3b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.704081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe56c45-e838-420b-89b8-ab06e94f3b8f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.710546 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e2aeb-5979-49af-be27-c1216e601368 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.712384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e2aeb-5979-49af-be27-c1216e601368 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.730140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 94/196] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:37:32 2022] POST /identity/v3/users => generated 298 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:32.730960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 103/197] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:32.735156 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe56c45-e838-420b-89b8-ab06e94f3b8f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.735748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e02fe-e36a-4324-850b-520b3e4f5050 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.736038 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e02fe-e36a-4324-850b-520b3e4f5050 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.736368 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e02fe-e36a-4324-850b-520b3e4f5050 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.738656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 104/198] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:32.745644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffb5b-c278-4649-8703-58e9382b9e4c None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.746029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffb5b-c278-4649-8703-58e9382b9e4c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.746472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffb5b-c278-4649-8703-58e9382b9e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.751250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe56c45-e838-420b-89b8-ab06e94f3b8f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.756147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf5014-1ff0-4426-bdca-89f1cf239b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.757116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf5014-1ff0-4426-bdca-89f1cf239b98 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.757399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf5014-1ff0-4426-bdca-89f1cf239b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.757666 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf5014-1ff0-4426-bdca-89f1cf239b98 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.759068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf5014-1ff0-4426-bdca-89f1cf239b98 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.761849 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf5014-1ff0-4426-bdca-89f1cf239b98 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.764027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 95/199] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:32.769423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-eddffb5b-c278-4649-8703-58e9382b9e4c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:32.769942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf5014-1ff0-4426-bdca-89f1cf239b98 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.770818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-eddffb5b-c278-4649-8703-58e9382b9e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:32.779776 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 105/200] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:32 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:32.784034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf5014-1ff0-4426-bdca-89f1cf239b98 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.796352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926e8f7-0d6e-4440-9da1-9781dfa76c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.797088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e8f7-0d6e-4440-9da1-9781dfa76c0a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.797696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e8f7-0d6e-4440-9da1-9781dfa76c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.797977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e8f7-0d6e-4440-9da1-9781dfa76c0a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.798961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926e8f7-0d6e-4440-9da1-9781dfa76c0a admin admin] RBAC: Adding query filter params (role.id=2d582daf740f43a8bd4b4471a3c1a99a, scope.project.id=3a4097a2cc55405b80afdb315dd566fe, user.id=7257ec05d8424a2d909dd62fae7572b9) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:32.799281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926e8f7-0d6e-4440-9da1-9781dfa76c0a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.801440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926e8f7-0d6e-4440-9da1-9781dfa76c0a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.804321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddffb5b-c278-4649-8703-58e9382b9e4c None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.812759 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 96/201] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/role_assignments?user.id=7257ec05d8424a2d909dd62fae7572b9&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=2d582daf740f43a8bd4b4471a3c1a99a => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:32.821859 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddffb5b-c278-4649-8703-58e9382b9e4c None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.828180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3b1aa-6972-45ae-b459-ba129cf4542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.829246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3b1aa-6972-45ae-b459-ba129cf4542f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.829627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3b1aa-6972-45ae-b459-ba129cf4542f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.830013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3b1aa-6972-45ae-b459-ba129cf4542f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.844354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3b1aa-6972-45ae-b459-ba129cf4542f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:32.851830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-a1b3b1aa-6972-45ae-b459-ba129cf4542f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 24 16:37:32.853448 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 106/202] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:37:32.860149 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926e8f7-0d6e-4440-9da1-9781dfa76c0a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.871571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926e8f7-0d6e-4440-9da1-9781dfa76c0a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.876742 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78300f36-3c92-4f89-9aa4-cc0ae5868590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.877519 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78300f36-3c92-4f89-9aa4-cc0ae5868590 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.877800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78300f36-3c92-4f89-9aa4-cc0ae5868590 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.878128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78300f36-3c92-4f89-9aa4-cc0ae5868590 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.879041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78300f36-3c92-4f89-9aa4-cc0ae5868590 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:32.879350 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78300f36-3c92-4f89-9aa4-cc0ae5868590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.881181 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78300f36-3c92-4f89-9aa4-cc0ae5868590 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.892780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 97/203] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:32.898600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3b1aa-6972-45ae-b459-ba129cf4542f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.909922 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3b1aa-6972-45ae-b459-ba129cf4542f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.914964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158a59c-b537-444e-ad8c-87b360e6a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.916147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158a59c-b537-444e-ad8c-87b360e6a9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.916407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158a59c-b537-444e-ad8c-87b360e6a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.916771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158a59c-b537-444e-ad8c-87b360e6a9f1 admin admin] PATH_INFO: `/v3/users/8e1de38dc4c546129019277bbd8dfc5a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.918407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158a59c-b537-444e-ad8c-87b360e6a9f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e1de38dc4c546129019277bbd8dfc5a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.920865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158a59c-b537-444e-ad8c-87b360e6a9f1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.922936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 107/204] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/users/8e1de38dc4c546129019277bbd8dfc5a => generated 290 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:32.928856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78300f36-3c92-4f89-9aa4-cc0ae5868590 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.940307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78300f36-3c92-4f89-9aa4-cc0ae5868590 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.945121 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55eca0-ba2e-4d0d-a7d9-8b275f9dbeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.945839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55eca0-ba2e-4d0d-a7d9-8b275f9dbeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.946115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55eca0-ba2e-4d0d-a7d9-8b275f9dbeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.946390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55eca0-ba2e-4d0d-a7d9-8b275f9dbeb5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.956825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55eca0-ba2e-4d0d-a7d9-8b275f9dbeb5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.958779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55eca0-ba2e-4d0d-a7d9-8b275f9dbeb5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:32.972532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 98/205] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:32.975646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158a59c-b537-444e-ad8c-87b360e6a9f1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:32.987751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158a59c-b537-444e-ad8c-87b360e6a9f1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:32.992616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabec76-e5fb-4c3b-9af6-7116376c75ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:32.993542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabec76-e5fb-4c3b-9af6-7116376c75ef admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:32.993818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabec76-e5fb-4c3b-9af6-7116376c75ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:32.994146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabec76-e5fb-4c3b-9af6-7116376c75ef admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:32.995659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabec76-e5fb-4c3b-9af6-7116376c75ef admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:32.997909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabec76-e5fb-4c3b-9af6-7116376c75ef admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:33.000049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 108/206] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:32 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:33.005465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55eca0-ba2e-4d0d-a7d9-8b275f9dbeb5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:33.014944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55eca0-ba2e-4d0d-a7d9-8b275f9dbeb5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:33.019320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee44bc-d710-4213-86a3-0721f0078e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:33.019960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee44bc-d710-4213-86a3-0721f0078e11 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:33.020238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee44bc-d710-4213-86a3-0721f0078e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:33.020508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee44bc-d710-4213-86a3-0721f0078e11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:33.021358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee44bc-d710-4213-86a3-0721f0078e11 admin admin] RBAC: Adding query filter params (role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b, user.id=8e1de38dc4c546129019277bbd8dfc5a) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:33.021672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee44bc-d710-4213-86a3-0721f0078e11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:33.023520 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee44bc-d710-4213-86a3-0721f0078e11 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:33.030606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 99/207] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:33 2022] GET /identity/v3/role_assignments?user.id=8e1de38dc4c546129019277bbd8dfc5a&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5 => generated 610 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:34.964149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe591aa-9c46-4c28-b91b-e988b01ed94a None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:34.964827 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe591aa-9c46-4c28-b91b-e988b01ed94a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:34.964827 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe591aa-9c46-4c28-b91b-e988b01ed94a None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:34.966576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 109/208] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:34.971882 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c522-392e-455b-be00-82d9d7947284 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:34.972380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c522-392e-455b-be00-82d9d7947284 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:34.972529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c522-392e-455b-be00-82d9d7947284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:34.990637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-c958c522-392e-455b-be00-82d9d7947284 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:34.991843 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c958c522-392e-455b-be00-82d9d7947284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:35.006864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 100/209] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:34 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:35.024719 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe591aa-9c46-4c28-b91b-e988b01ed94a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.037520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe591aa-9c46-4c28-b91b-e988b01ed94a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.041954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcde6c-0804-4a61-9273-a62a8eaa8c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.042743 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcde6c-0804-4a61-9273-a62a8eaa8c3d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.043061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcde6c-0804-4a61-9273-a62a8eaa8c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.043332 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcde6c-0804-4a61-9273-a62a8eaa8c3d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.054310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcde6c-0804-4a61-9273-a62a8eaa8c3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:35.061746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-57dcde6c-0804-4a61-9273-a62a8eaa8c3d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:35.063150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 110/210] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:35.068827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c522-392e-455b-be00-82d9d7947284 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.080228 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c522-392e-455b-be00-82d9d7947284 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.085383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3d1b7-bf42-4f36-9c8e-bc601bf4e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.086043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3d1b7-bf42-4f36-9c8e-bc601bf4e303 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.086319 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3d1b7-bf42-4f36-9c8e-bc601bf4e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.086594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3d1b7-bf42-4f36-9c8e-bc601bf4e303 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.087390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3d1b7-bf42-4f36-9c8e-bc601bf4e303 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:35.087741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3d1b7-bf42-4f36-9c8e-bc601bf4e303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.089625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3d1b7-bf42-4f36-9c8e-bc601bf4e303 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.104021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 101/211] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:35.105790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcde6c-0804-4a61-9273-a62a8eaa8c3d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.116141 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcde6c-0804-4a61-9273-a62a8eaa8c3d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.121806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef0ea5-a388-4f9f-ac0b-705c216fa58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.122678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef0ea5-a388-4f9f-ac0b-705c216fa58f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.122989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef0ea5-a388-4f9f-ac0b-705c216fa58f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.123260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef0ea5-a388-4f9f-ac0b-705c216fa58f admin admin] PATH_INFO: `/v3/users/7257ec05d8424a2d909dd62fae7572b9` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.124523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef0ea5-a388-4f9f-ac0b-705c216fa58f admin admin] RBAC: Authorizing `identity:get_user(user_id=7257ec05d8424a2d909dd62fae7572b9)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.126682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef0ea5-a388-4f9f-ac0b-705c216fa58f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.132400 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 111/212] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/users/7257ec05d8424a2d909dd62fae7572b9 => generated 284 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:35.136539 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3d1b7-bf42-4f36-9c8e-bc601bf4e303 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.146189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3d1b7-bf42-4f36-9c8e-bc601bf4e303 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.151205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4b50b-dbe1-41e3-aaf3-829a951549c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.152047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4b50b-dbe1-41e3-aaf3-829a951549c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.152320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4b50b-dbe1-41e3-aaf3-829a951549c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.152589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4b50b-dbe1-41e3-aaf3-829a951549c7 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.153816 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4b50b-dbe1-41e3-aaf3-829a951549c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.156409 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4b50b-dbe1-41e3-aaf3-829a951549c7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.162580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 102/213] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:35.163897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef0ea5-a388-4f9f-ac0b-705c216fa58f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.174822 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef0ea5-a388-4f9f-ac0b-705c216fa58f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.179223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b0c3-ce10-4d7d-8539-1d23d44e74c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.180087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b0c3-ce10-4d7d-8539-1d23d44e74c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.180363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b0c3-ce10-4d7d-8539-1d23d44e74c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.180631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b0c3-ce10-4d7d-8539-1d23d44e74c5 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe/users/7257ec05d8424a2d909dd62fae7572b9/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.183312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2797c0-9eb5-46a7-8e5f-b112b4fdc76a None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.183594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2797c0-9eb5-46a7-8e5f-b112b4fdc76a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.183865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2797c0-9eb5-46a7-8e5f-b112b4fdc76a None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.184210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985b0c3-ce10-4d7d-8539-1d23d44e74c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4097a2cc55405b80afdb315dd566fe, user_id=7257ec05d8424a2d909dd62fae7572b9, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.185877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 103/214] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:35.186876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985b0c3-ce10-4d7d-8539-1d23d44e74c5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.192968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fb1eb-d4ab-47f8-943e-327e4c817c48 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.193249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fb1eb-d4ab-47f8-943e-327e4c817c48 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.193726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fb1eb-d4ab-47f8-943e-327e4c817c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.204436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 112/215] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:37:35 2022] PUT /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe/users/7257ec05d8424a2d909dd62fae7572b9/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:37:35.215379 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-8a6fb1eb-d4ab-47f8-943e-327e4c817c48 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:35.217000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8a6fb1eb-d4ab-47f8-943e-327e4c817c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:35.284919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 104/216] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:35 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:35.304179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e64a-e6dd-465a-8d30-ea540786cea4 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.304466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e64a-e6dd-465a-8d30-ea540786cea4 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.304744 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e64a-e6dd-465a-8d30-ea540786cea4 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.306780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 113/217] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:35.310058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fb1eb-d4ab-47f8-943e-327e4c817c48 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.314371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948c90-1f53-4c1b-b2c3-d2351ac650d3 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.314520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948c90-1f53-4c1b-b2c3-d2351ac650d3 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.314721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948c90-1f53-4c1b-b2c3-d2351ac650d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.319262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fb1eb-d4ab-47f8-943e-327e4c817c48 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.326857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaf7b1-fa5b-4ce9-8e72-536049bb497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.327756 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaf7b1-fa5b-4ce9-8e72-536049bb497f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.328043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaf7b1-fa5b-4ce9-8e72-536049bb497f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.328321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaf7b1-fa5b-4ce9-8e72-536049bb497f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.340035 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-92948c90-1f53-4c1b-b2c3-d2351ac650d3 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:35.341401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-92948c90-1f53-4c1b-b2c3-d2351ac650d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:35.341507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaf7b1-fa5b-4ce9-8e72-536049bb497f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:35.349198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-28aaf7b1-fa5b-4ce9-8e72-536049bb497f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:35.350732 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 105/218] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:35.351651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 114/219] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:35 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:35.356920 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaf7b1-fa5b-4ce9-8e72-536049bb497f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.364951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eb5b1-6d4c-4649-929b-029737e50356 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.365234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eb5b1-6d4c-4649-929b-029737e50356 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.365618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eb5b1-6d4c-4649-929b-029737e50356 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.367451 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 115/220] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:37:35.373164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120097b-257b-4fde-9e23-02af5328895c None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.373448 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120097b-257b-4fde-9e23-02af5328895c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.373727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120097b-257b-4fde-9e23-02af5328895c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.374079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaf7b1-fa5b-4ce9-8e72-536049bb497f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.378842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f41a23-ce2c-4f6e-8376-2b20cf19c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.379405 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f41a23-ce2c-4f6e-8376-2b20cf19c32a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.379684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f41a23-ce2c-4f6e-8376-2b20cf19c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.379955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f41a23-ce2c-4f6e-8376-2b20cf19c32a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.380738 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f41a23-ce2c-4f6e-8376-2b20cf19c32a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:35.381042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f41a23-ce2c-4f6e-8376-2b20cf19c32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.382684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f41a23-ce2c-4f6e-8376-2b20cf19c32a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.392928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 106/221] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:35.393255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-1120097b-257b-4fde-9e23-02af5328895c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:35.393685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f41a23-ce2c-4f6e-8376-2b20cf19c32a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.394330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1120097b-257b-4fde-9e23-02af5328895c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:35.405358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 116/222] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:35 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:35.405514 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f41a23-ce2c-4f6e-8376-2b20cf19c32a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.406870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120097b-257b-4fde-9e23-02af5328895c None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.415500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3f29c-1bf8-4fc9-844a-951931050d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.416980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3f29c-1bf8-4fc9-844a-951931050d8a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.417267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3f29c-1bf8-4fc9-844a-951931050d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.417545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3f29c-1bf8-4fc9-844a-951931050d8a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.417639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120097b-257b-4fde-9e23-02af5328895c None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.422238 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1bb7a-47d6-4d34-9f60-443373997a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.423201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1bb7a-47d6-4d34-9f60-443373997a9b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.423484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1bb7a-47d6-4d34-9f60-443373997a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.423811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1bb7a-47d6-4d34-9f60-443373997a9b admin admin] PATH_INFO: `/v3/users/7257ec05d8424a2d909dd62fae7572b9` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.425681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1bb7a-47d6-4d34-9f60-443373997a9b admin admin] RBAC: Authorizing `identity:get_user(user_id=7257ec05d8424a2d909dd62fae7572b9)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.427964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1bb7a-47d6-4d34-9f60-443373997a9b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.429821 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 117/223] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/users/7257ec05d8424a2d909dd62fae7572b9 => generated 284 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:35.430315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1bb7a-47d6-4d34-9f60-443373997a9b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.430645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3f29c-1bf8-4fc9-844a-951931050d8a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:35.439550 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-32c3f29c-1bf8-4fc9-844a-951931050d8a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:35.439997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1bb7a-47d6-4d34-9f60-443373997a9b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.440870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 107/224] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:35.444361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cae75-f014-4ec2-8f48-7bcdd79af446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.445127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cae75-f014-4ec2-8f48-7bcdd79af446 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.445458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cae75-f014-4ec2-8f48-7bcdd79af446 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.445732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cae75-f014-4ec2-8f48-7bcdd79af446 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.445984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3f29c-1bf8-4fc9-844a-951931050d8a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.447548 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cae75-f014-4ec2-8f48-7bcdd79af446 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.449626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cae75-f014-4ec2-8f48-7bcdd79af446 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.451397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 118/225] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/domains/default => generated 200 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:35.453024 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cae75-f014-4ec2-8f48-7bcdd79af446 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.457081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3f29c-1bf8-4fc9-844a-951931050d8a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.461536 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3572674-ad84-4fbb-b4ad-0e88b0788b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.462363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3572674-ad84-4fbb-b4ad-0e88b0788b22 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.463306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3572674-ad84-4fbb-b4ad-0e88b0788b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.463598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3572674-ad84-4fbb-b4ad-0e88b0788b22 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.464780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3572674-ad84-4fbb-b4ad-0e88b0788b22 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.466902 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3572674-ad84-4fbb-b4ad-0e88b0788b22 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.467641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cae75-f014-4ec2-8f48-7bcdd79af446 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.468615 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 108/226] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:35.469337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3572674-ad84-4fbb-b4ad-0e88b0788b22 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.476947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e217c-3335-48a0-8622-4fdeb65aee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.477594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e217c-3335-48a0-8622-4fdeb65aee80 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.477875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e217c-3335-48a0-8622-4fdeb65aee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.478148 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e217c-3335-48a0-8622-4fdeb65aee80 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.478589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3572674-ad84-4fbb-b4ad-0e88b0788b22 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.479825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e217c-3335-48a0-8622-4fdeb65aee80 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:35.480201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e217c-3335-48a0-8622-4fdeb65aee80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.481773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e217c-3335-48a0-8622-4fdeb65aee80 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.483302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ffd49-2720-489e-aaa2-a015c07e7f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.483792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ffd49-2720-489e-aaa2-a015c07e7f37 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.484276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ffd49-2720-489e-aaa2-a015c07e7f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.484378 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ffd49-2720-489e-aaa2-a015c07e7f37 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.485006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ffd49-2720-489e-aaa2-a015c07e7f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.486884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ffd49-2720-489e-aaa2-a015c07e7f37 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.490577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 119/227] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:35.491211 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e217c-3335-48a0-8622-4fdeb65aee80 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.504682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e217c-3335-48a0-8622-4fdeb65aee80 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.510029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22f6c3-8014-4a03-9b2f-6559e8094f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.511079 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22f6c3-8014-4a03-9b2f-6559e8094f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.511355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22f6c3-8014-4a03-9b2f-6559e8094f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.511711 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22f6c3-8014-4a03-9b2f-6559e8094f15 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe/users/7257ec05d8424a2d909dd62fae7572b9/roles/2d582daf740f43a8bd4b4471a3c1a99a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.513163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 109/228] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:37:35 2022] POST /identity/v3/users => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:35.513984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ffd49-2720-489e-aaa2-a015c07e7f37 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.515874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22f6c3-8014-4a03-9b2f-6559e8094f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4097a2cc55405b80afdb315dd566fe, user_id=7257ec05d8424a2d909dd62fae7572b9, role_id=2d582daf740f43a8bd4b4471a3c1a99a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.518542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22f6c3-8014-4a03-9b2f-6559e8094f15 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.534670 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ffd49-2720-489e-aaa2-a015c07e7f37 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.536225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 120/229] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:37:35 2022] PUT /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe/users/7257ec05d8424a2d909dd62fae7572b9/roles/2d582daf740f43a8bd4b4471a3c1a99a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:37:35.611899 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7b6f0-a46c-48e3-87e3-4a98513e8331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.613421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b6f0-a46c-48e3-87e3-4a98513e8331 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.613703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b6f0-a46c-48e3-87e3-4a98513e8331 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.613976 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b6f0-a46c-48e3-87e3-4a98513e8331 admin admin] PATH_INFO: `/v3/users/c985ab1170464eeeb37d277d40af7392` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.629797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7b6f0-a46c-48e3-87e3-4a98513e8331 admin admin] RBAC: Authorizing `identity:get_user(user_id=c985ab1170464eeeb37d277d40af7392)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.632042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7b6f0-a46c-48e3-87e3-4a98513e8331 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.633836 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 110/230] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/users/c985ab1170464eeeb37d277d40af7392 => generated 298 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:35.640867 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22f6c3-8014-4a03-9b2f-6559e8094f15 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.652455 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22f6c3-8014-4a03-9b2f-6559e8094f15 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.657602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2003b4-cd63-4035-add8-208f8e8c2f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.658323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2003b4-cd63-4035-add8-208f8e8c2f41 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.658610 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2003b4-cd63-4035-add8-208f8e8c2f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.659043 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2003b4-cd63-4035-add8-208f8e8c2f41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.668695 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2003b4-cd63-4035-add8-208f8e8c2f41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.670571 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2003b4-cd63-4035-add8-208f8e8c2f41 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.680999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 121/231] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:35.687500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7b6f0-a46c-48e3-87e3-4a98513e8331 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.699205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7b6f0-a46c-48e3-87e3-4a98513e8331 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.703823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bb5c5-84d5-4887-8446-b389e68fe5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.704804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb5c5-84d5-4887-8446-b389e68fe5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.705138 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb5c5-84d5-4887-8446-b389e68fe5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.705410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb5c5-84d5-4887-8446-b389e68fe5b1 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.706847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bb5c5-84d5-4887-8446-b389e68fe5b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.708960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bb5c5-84d5-4887-8446-b389e68fe5b1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.710931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 111/232] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:35.717298 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2003b4-cd63-4035-add8-208f8e8c2f41 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:35.726406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2003b4-cd63-4035-add8-208f8e8c2f41 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:35.734780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecb5d4-44d2-4764-8e09-d789e34b98f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:35.735707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecb5d4-44d2-4764-8e09-d789e34b98f0 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:35.735988 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecb5d4-44d2-4764-8e09-d789e34b98f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:35.736258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecb5d4-44d2-4764-8e09-d789e34b98f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:35.737114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecb5d4-44d2-4764-8e09-d789e34b98f0 admin admin] RBAC: Adding query filter params (role.id=42656495a54b4164862c9a31838a731e, scope.project.id=3a4097a2cc55405b80afdb315dd566fe, user.id=c985ab1170464eeeb37d277d40af7392) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:35.737418 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecb5d4-44d2-4764-8e09-d789e34b98f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:35.739361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecb5d4-44d2-4764-8e09-d789e34b98f0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:35.747005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 122/233] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:35 2022] GET /identity/v3/role_assignments?user.id=c985ab1170464eeeb37d277d40af7392&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=42656495a54b4164862c9a31838a731e => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:37.856632 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a167cc-674c-4b2c-8030-bc0092c8db5d None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:37.857141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a167cc-674c-4b2c-8030-bc0092c8db5d None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:37.857141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a167cc-674c-4b2c-8030-bc0092c8db5d None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:37.859187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 112/234] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:37.864724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2b57d-5409-4e5e-94b7-d6221ad28a23 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:37.865139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2b57d-5409-4e5e-94b7-d6221ad28a23 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:37.865304 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2b57d-5409-4e5e-94b7-d6221ad28a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:37.890766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-84a2b57d-5409-4e5e-94b7-d6221ad28a23 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:37.891950 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-84a2b57d-5409-4e5e-94b7-d6221ad28a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:37.899644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 123/235] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:37 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:37.944002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a167cc-674c-4b2c-8030-bc0092c8db5d None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:37.958523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a167cc-674c-4b2c-8030-bc0092c8db5d None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:37.971139 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0320fa-637d-4d66-b0d0-bae70ea69371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:37.971928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0320fa-637d-4d66-b0d0-bae70ea69371 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:37.972208 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0320fa-637d-4d66-b0d0-bae70ea69371 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:37.972479 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0320fa-637d-4d66-b0d0-bae70ea69371 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:37.984079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0320fa-637d-4d66-b0d0-bae70ea69371 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:37.990838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-5c0320fa-637d-4d66-b0d0-bae70ea69371 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:37.992022 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 113/236] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:37.997755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2b57d-5409-4e5e-94b7-d6221ad28a23 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.011800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2b57d-5409-4e5e-94b7-d6221ad28a23 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.016178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e8c29-638d-436f-924d-70c898c75d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.016839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8c29-638d-436f-924d-70c898c75d94 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.017119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8c29-638d-436f-924d-70c898c75d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.017393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8c29-638d-436f-924d-70c898c75d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.018157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e8c29-638d-436f-924d-70c898c75d94 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:38.018461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e8c29-638d-436f-924d-70c898c75d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.020095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e8c29-638d-436f-924d-70c898c75d94 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.034613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 124/237] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:38.040107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0320fa-637d-4d66-b0d0-bae70ea69371 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.051838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0320fa-637d-4d66-b0d0-bae70ea69371 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.060881 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ab281-f87a-44db-a1f7-5fe1013f9f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.061786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ab281-f87a-44db-a1f7-5fe1013f9f96 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.062064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ab281-f87a-44db-a1f7-5fe1013f9f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.062334 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ab281-f87a-44db-a1f7-5fe1013f9f96 admin admin] PATH_INFO: `/v3/users/7257ec05d8424a2d909dd62fae7572b9` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.063718 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ab281-f87a-44db-a1f7-5fe1013f9f96 admin admin] RBAC: Authorizing `identity:get_user(user_id=7257ec05d8424a2d909dd62fae7572b9)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.065882 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ab281-f87a-44db-a1f7-5fe1013f9f96 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.067573 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 114/238] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/users/7257ec05d8424a2d909dd62fae7572b9 => generated 284 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:38.073343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e8c29-638d-436f-924d-70c898c75d94 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.088153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e8c29-638d-436f-924d-70c898c75d94 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.092476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f9926-0a74-4460-a566-12b74a8ae90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.093107 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f9926-0a74-4460-a566-12b74a8ae90b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.093386 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f9926-0a74-4460-a566-12b74a8ae90b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.093656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f9926-0a74-4460-a566-12b74a8ae90b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.108005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f9926-0a74-4460-a566-12b74a8ae90b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.109673 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f9926-0a74-4460-a566-12b74a8ae90b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.124625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 125/239] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:38.130041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ab281-f87a-44db-a1f7-5fe1013f9f96 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.140213 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ab281-f87a-44db-a1f7-5fe1013f9f96 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.148771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595797f5-73c5-47a7-ac5c-6616d7ea7eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.149620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595797f5-73c5-47a7-ac5c-6616d7ea7eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.150475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595797f5-73c5-47a7-ac5c-6616d7ea7eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.150701 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595797f5-73c5-47a7-ac5c-6616d7ea7eb3 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.152012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595797f5-73c5-47a7-ac5c-6616d7ea7eb3 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.154049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595797f5-73c5-47a7-ac5c-6616d7ea7eb3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.155750 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 115/240] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:38.161479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f9926-0a74-4460-a566-12b74a8ae90b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.176010 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f9926-0a74-4460-a566-12b74a8ae90b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.180608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df2d9c-85fd-45b5-8ece-bb2222ddde84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.181326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df2d9c-85fd-45b5-8ece-bb2222ddde84 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.181608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df2d9c-85fd-45b5-8ece-bb2222ddde84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.181881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df2d9c-85fd-45b5-8ece-bb2222ddde84 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.182776 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df2d9c-85fd-45b5-8ece-bb2222ddde84 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=3a4097a2cc55405b80afdb315dd566fe, user.id=7257ec05d8424a2d909dd62fae7572b9) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:38.183110 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df2d9c-85fd-45b5-8ece-bb2222ddde84 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.185004 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df2d9c-85fd-45b5-8ece-bb2222ddde84 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.200413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 126/241] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/role_assignments?user.id=7257ec05d8424a2d909dd62fae7572b9&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 610 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:38.346451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac6ef2-e3bd-4c17-813a-aa516e9c3f7a None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.346804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac6ef2-e3bd-4c17-813a-aa516e9c3f7a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.347018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac6ef2-e3bd-4c17-813a-aa516e9c3f7a None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.349294 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 116/242] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:38.355674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13abbd-48d1-45cb-86da-8f37c77df79b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.355946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13abbd-48d1-45cb-86da-8f37c77df79b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.356215 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13abbd-48d1-45cb-86da-8f37c77df79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.376647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5b13abbd-48d1-45cb-86da-8f37c77df79b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:38.378196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5b13abbd-48d1-45cb-86da-8f37c77df79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:38.390798 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 127/243] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:38 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:38.419314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac6ef2-e3bd-4c17-813a-aa516e9c3f7a None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.436307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac6ef2-e3bd-4c17-813a-aa516e9c3f7a None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.442697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daf3d3-e5e3-4627-bf48-54c5f0f9188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.443517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daf3d3-e5e3-4627-bf48-54c5f0f9188d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.443622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab6ab-662d-4f7c-b9ce-cc6c70b9fd14 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.443802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daf3d3-e5e3-4627-bf48-54c5f0f9188d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.443914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab6ab-662d-4f7c-b9ce-cc6c70b9fd14 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.444059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daf3d3-e5e3-4627-bf48-54c5f0f9188d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.444146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab6ab-662d-4f7c-b9ce-cc6c70b9fd14 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.446105 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 128/244] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:38.452013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8544156-7643-4fef-9563-1cb09cf37304 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.452298 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8544156-7643-4fef-9563-1cb09cf37304 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.452573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8544156-7643-4fef-9563-1cb09cf37304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.461350 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5daf3d3-e5e3-4627-bf48-54c5f0f9188d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:38.468920 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-d5daf3d3-e5e3-4627-bf48-54c5f0f9188d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:38.470397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 117/245] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:38.474321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b8544156-7643-4fef-9563-1cb09cf37304 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:38.475592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b8544156-7643-4fef-9563-1cb09cf37304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:38.477246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daf3d3-e5e3-4627-bf48-54c5f0f9188d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.488647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daf3d3-e5e3-4627-bf48-54c5f0f9188d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.492613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 129/246] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:38 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:38.499874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21664cd-ccff-4e60-8d03-bbe47a6fe5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.500593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21664cd-ccff-4e60-8d03-bbe47a6fe5cf admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.500873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21664cd-ccff-4e60-8d03-bbe47a6fe5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.501197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21664cd-ccff-4e60-8d03-bbe47a6fe5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.502061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21664cd-ccff-4e60-8d03-bbe47a6fe5cf admin admin] RBAC: Adding query filter params (name=member) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:38.502366 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21664cd-ccff-4e60-8d03-bbe47a6fe5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.504163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21664cd-ccff-4e60-8d03-bbe47a6fe5cf admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.514645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 118/247] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:38.520796 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21664cd-ccff-4e60-8d03-bbe47a6fe5cf admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.521375 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8544156-7643-4fef-9563-1cb09cf37304 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.531600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21664cd-ccff-4e60-8d03-bbe47a6fe5cf admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.533657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8544156-7643-4fef-9563-1cb09cf37304 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.536682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01fde6-a65b-40c8-bc34-cf42f66fb3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.537472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01fde6-a65b-40c8-bc34-cf42f66fb3ed admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.537751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01fde6-a65b-40c8-bc34-cf42f66fb3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.538027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01fde6-a65b-40c8-bc34-cf42f66fb3ed admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.539400 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01fde6-a65b-40c8-bc34-cf42f66fb3ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.539904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a905b-c0d1-4ed0-a3f0-4a6e64ff6e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.541456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a905b-c0d1-4ed0-a3f0-4a6e64ff6e5e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.541808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01fde6-a65b-40c8-bc34-cf42f66fb3ed admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.542026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a905b-c0d1-4ed0-a3f0-4a6e64ff6e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.542459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a905b-c0d1-4ed0-a3f0-4a6e64ff6e5e admin admin] PATH_INFO: `/v3/users/c985ab1170464eeeb37d277d40af7392` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.543685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 119/248] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/domains/default => generated 200 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:38.544011 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a905b-c0d1-4ed0-a3f0-4a6e64ff6e5e admin admin] RBAC: Authorizing `identity:get_user(user_id=c985ab1170464eeeb37d277d40af7392)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.544866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f8ff4-c1b8-4b17-8ab5-aefb7d6073cf None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.545144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f8ff4-c1b8-4b17-8ab5-aefb7d6073cf None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.545416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f8ff4-c1b8-4b17-8ab5-aefb7d6073cf None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.546775 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a905b-c0d1-4ed0-a3f0-4a6e64ff6e5e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.547290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 120/249] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:38.552855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 130/250] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/users/c985ab1170464eeeb37d277d40af7392 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:38.554286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a905b-c0d1-4ed0-a3f0-4a6e64ff6e5e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.555782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ac6ac-36db-442c-9bd8-8715fa3215b1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.555782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ac6ac-36db-442c-9bd8-8715fa3215b1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.555782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ac6ac-36db-442c-9bd8-8715fa3215b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.565309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a905b-c0d1-4ed0-a3f0-4a6e64ff6e5e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.570933 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810963bb-b377-47d8-943a-3d367390f811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.571591 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810963bb-b377-47d8-943a-3d367390f811 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.572513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810963bb-b377-47d8-943a-3d367390f811 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.572940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810963bb-b377-47d8-943a-3d367390f811 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.573704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810963bb-b377-47d8-943a-3d367390f811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.574731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-810963bb-b377-47d8-943a-3d367390f811 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:38.574731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:37:38.574731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:37:38.575945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810963bb-b377-47d8-943a-3d367390f811 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.579938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ac8ac6ac-36db-442c-9bd8-8715fa3215b1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:38.581353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ac8ac6ac-36db-442c-9bd8-8715fa3215b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:38.590110 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 121/251] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:38 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:38.591192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ac6ac-36db-442c-9bd8-8715fa3215b1 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.602932 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ac6ac-36db-442c-9bd8-8715fa3215b1 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.609087 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9f574-58bd-431d-83ae-114a62a7383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.610222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9f574-58bd-431d-83ae-114a62a7383e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.610506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9f574-58bd-431d-83ae-114a62a7383e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.610856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9f574-58bd-431d-83ae-114a62a7383e admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.612064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9f574-58bd-431d-83ae-114a62a7383e admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.614171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9f574-58bd-431d-83ae-114a62a7383e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.615809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 131/252] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:37:38 2022] POST /identity/v3/users => generated 294 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:38.616321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 122/253] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:38.622192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810963bb-b377-47d8-943a-3d367390f811 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.624254 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9f574-58bd-431d-83ae-114a62a7383e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.635289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810963bb-b377-47d8-943a-3d367390f811 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.636959 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9f574-58bd-431d-83ae-114a62a7383e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.641024 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f66bb-9ba9-418f-9e41-7e955cabcccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.641867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2da34-2ad8-4ff5-b483-a245697e4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.642574 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f66bb-9ba9-418f-9e41-7e955cabcccd admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.642766 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2da34-2ad8-4ff5-b483-a245697e4c94 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.643069 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2da34-2ad8-4ff5-b483-a245697e4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.643397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2da34-2ad8-4ff5-b483-a245697e4c94 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.643644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f66bb-9ba9-418f-9e41-7e955cabcccd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.644296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f66bb-9ba9-418f-9e41-7e955cabcccd admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe/users/c985ab1170464eeeb37d277d40af7392/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.647397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f66bb-9ba9-418f-9e41-7e955cabcccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4097a2cc55405b80afdb315dd566fe, user_id=c985ab1170464eeeb37d277d40af7392, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.651888 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f66bb-9ba9-418f-9e41-7e955cabcccd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.657809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2da34-2ad8-4ff5-b483-a245697e4c94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:38.668218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-4cf2da34-2ad8-4ff5-b483-a245697e4c94 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 24 16:37:38.675141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 123/255] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:37:38.675329 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 132/255] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:37:38 2022] PUT /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe/users/c985ab1170464eeeb37d277d40af7392/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:37:38.679517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1b64-71ed-4d04-946f-e968923bd31d None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.679828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1b64-71ed-4d04-946f-e968923bd31d None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.680232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1b64-71ed-4d04-946f-e968923bd31d None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.681977 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f66bb-9ba9-418f-9e41-7e955cabcccd admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.683217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 124/256] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:38 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:38.689413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82fe9e-00fe-4663-b340-998fb222e922 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.689704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82fe9e-00fe-4663-b340-998fb222e922 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.689987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82fe9e-00fe-4663-b340-998fb222e922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.713240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-cf82fe9e-00fe-4663-b340-998fb222e922 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:38.714722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-cf82fe9e-00fe-4663-b340-998fb222e922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:38.754356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f66bb-9ba9-418f-9e41-7e955cabcccd admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.760781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c70293-d3d3-4316-a1bc-b9be1ea36c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.761720 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c70293-d3d3-4316-a1bc-b9be1ea36c58 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.762265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c70293-d3d3-4316-a1bc-b9be1ea36c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.762539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c70293-d3d3-4316-a1bc-b9be1ea36c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.763370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c70293-d3d3-4316-a1bc-b9be1ea36c58 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:38.763676 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c70293-d3d3-4316-a1bc-b9be1ea36c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.765318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c70293-d3d3-4316-a1bc-b9be1ea36c58 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.783151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 133/257] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:38.784686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c70293-d3d3-4316-a1bc-b9be1ea36c58 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.794630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c70293-d3d3-4316-a1bc-b9be1ea36c58 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.798193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 125/258] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:38 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:38.802812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04c99c-d514-4e65-8a43-27a790322976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.802812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c99c-d514-4e65-8a43-27a790322976 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.802812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c99c-d514-4e65-8a43-27a790322976 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.802812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c99c-d514-4e65-8a43-27a790322976 admin admin] PATH_INFO: `/v3/users/a356e57b73214c959bddd781dc528d7a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.819134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04c99c-d514-4e65-8a43-27a790322976 admin admin] RBAC: Authorizing `identity:get_user(user_id=a356e57b73214c959bddd781dc528d7a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.821317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04c99c-d514-4e65-8a43-27a790322976 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.824554 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82fe9e-00fe-4663-b340-998fb222e922 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.825294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 134/259] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/users/a356e57b73214c959bddd781dc528d7a => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:38.829272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04c99c-d514-4e65-8a43-27a790322976 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.833995 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82fe9e-00fe-4663-b340-998fb222e922 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.842486 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04c99c-d514-4e65-8a43-27a790322976 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.843055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587cdb2-f09c-4405-beaf-a056c3e3febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.843937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587cdb2-f09c-4405-beaf-a056c3e3febf admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.844204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587cdb2-f09c-4405-beaf-a056c3e3febf admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.844479 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587cdb2-f09c-4405-beaf-a056c3e3febf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.848297 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bea9f7-7cad-4ffb-a6cc-f9247c90f9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.848976 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bea9f7-7cad-4ffb-a6cc-f9247c90f9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.849262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bea9f7-7cad-4ffb-a6cc-f9247c90f9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.849541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bea9f7-7cad-4ffb-a6cc-f9247c90f9d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.861770 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bea9f7-7cad-4ffb-a6cc-f9247c90f9d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.864053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bea9f7-7cad-4ffb-a6cc-f9247c90f9d2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.864616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587cdb2-f09c-4405-beaf-a056c3e3febf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:38.871940 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-8587cdb2-f09c-4405-beaf-a056c3e3febf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:38.873447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 126/260] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:37:38.874185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 135/261] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:37:38.880558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587cdb2-f09c-4405-beaf-a056c3e3febf admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.880965 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bea9f7-7cad-4ffb-a6cc-f9247c90f9d2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.890628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bea9f7-7cad-4ffb-a6cc-f9247c90f9d2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.895936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c15cd6-1661-43a6-a5d6-52363006f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.896842 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c15cd6-1661-43a6-a5d6-52363006f22e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.897124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c15cd6-1661-43a6-a5d6-52363006f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.897397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c15cd6-1661-43a6-a5d6-52363006f22e admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.898649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c15cd6-1661-43a6-a5d6-52363006f22e admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.900788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587cdb2-f09c-4405-beaf-a056c3e3febf admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.901301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c15cd6-1661-43a6-a5d6-52363006f22e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.903003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 136/262] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:38.908217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60676263-1bdf-4390-8791-b4d04880502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.908766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c15cd6-1661-43a6-a5d6-52363006f22e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.909253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676263-1bdf-4390-8791-b4d04880502e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.909705 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676263-1bdf-4390-8791-b4d04880502e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.910133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676263-1bdf-4390-8791-b4d04880502e admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.911124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60676263-1bdf-4390-8791-b4d04880502e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:38.911593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60676263-1bdf-4390-8791-b4d04880502e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.913329 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60676263-1bdf-4390-8791-b4d04880502e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.919243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c15cd6-1661-43a6-a5d6-52363006f22e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.923852 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b522b3e-7a50-4cdf-a1e7-f2bba3b54098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.924317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 127/263] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:38.924547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b522b3e-7a50-4cdf-a1e7-f2bba3b54098 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.924835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b522b3e-7a50-4cdf-a1e7-f2bba3b54098 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.925104 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b522b3e-7a50-4cdf-a1e7-f2bba3b54098 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.926020 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b522b3e-7a50-4cdf-a1e7-f2bba3b54098 admin admin] RBAC: Adding query filter params (role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5, scope.project.id=3a4097a2cc55405b80afdb315dd566fe, user.id=a356e57b73214c959bddd781dc528d7a) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:38.926332 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b522b3e-7a50-4cdf-a1e7-f2bba3b54098 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.928192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b522b3e-7a50-4cdf-a1e7-f2bba3b54098 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.929901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60676263-1bdf-4390-8791-b4d04880502e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.936062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 137/264] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/role_assignments?user.id=a356e57b73214c959bddd781dc528d7a&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5 => generated 260 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:38.944452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60676263-1bdf-4390-8791-b4d04880502e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.955047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3281771-a6ae-4f3f-9515-34cb14c2b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.956957 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3281771-a6ae-4f3f-9515-34cb14c2b36e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.958367 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3281771-a6ae-4f3f-9515-34cb14c2b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.959344 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3281771-a6ae-4f3f-9515-34cb14c2b36e admin admin] PATH_INFO: `/v3/users/7257ec05d8424a2d909dd62fae7572b9` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:38.962313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3281771-a6ae-4f3f-9515-34cb14c2b36e admin admin] RBAC: Authorizing `identity:get_user(user_id=7257ec05d8424a2d909dd62fae7572b9)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:38.967471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3281771-a6ae-4f3f-9515-34cb14c2b36e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:38.970114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 128/265] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/users/7257ec05d8424a2d909dd62fae7572b9 => generated 284 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:38.975805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b522b3e-7a50-4cdf-a1e7-f2bba3b54098 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:38.986675 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b522b3e-7a50-4cdf-a1e7-f2bba3b54098 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:38.991485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a389d-3fc7-49b4-b085-eb478a87c4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:38.992249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a389d-3fc7-49b4-b085-eb478a87c4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:38.992607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a389d-3fc7-49b4-b085-eb478a87c4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:38.992957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a389d-3fc7-49b4-b085-eb478a87c4c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:39.002905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a389d-3fc7-49b4-b085-eb478a87c4c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:39.004794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a389d-3fc7-49b4-b085-eb478a87c4c3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:39.015927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 138/266] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:38 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:39.021630 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3281771-a6ae-4f3f-9515-34cb14c2b36e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:39.032918 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3281771-a6ae-4f3f-9515-34cb14c2b36e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:39.038323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c3cbc-69ad-4f8e-bf4d-e8e104f4d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:39.039447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3cbc-69ad-4f8e-bf4d-e8e104f4d982 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:39.039831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3cbc-69ad-4f8e-bf4d-e8e104f4d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:39.040210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3cbc-69ad-4f8e-bf4d-e8e104f4d982 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:39.042389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c3cbc-69ad-4f8e-bf4d-e8e104f4d982 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:39.044633 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c3cbc-69ad-4f8e-bf4d-e8e104f4d982 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:39.046987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 129/267] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:39 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:39.052723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a389d-3fc7-49b4-b085-eb478a87c4c3 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:39.063672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a389d-3fc7-49b4-b085-eb478a87c4c3 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:39.068364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768410c-586a-436e-8f3f-03e62a412bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:39.069092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768410c-586a-436e-8f3f-03e62a412bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:39.069374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768410c-586a-436e-8f3f-03e62a412bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:39.069653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768410c-586a-436e-8f3f-03e62a412bb9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:39.070573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768410c-586a-436e-8f3f-03e62a412bb9 admin admin] RBAC: Adding query filter params (role.id=2d582daf740f43a8bd4b4471a3c1a99a, scope.project.id=3a4097a2cc55405b80afdb315dd566fe, user.id=7257ec05d8424a2d909dd62fae7572b9) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:39.070930 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768410c-586a-436e-8f3f-03e62a412bb9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:39.073042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768410c-586a-436e-8f3f-03e62a412bb9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:39.080282 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 139/268] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:39 2022] GET /identity/v3/role_assignments?user.id=7257ec05d8424a2d909dd62fae7572b9&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=2d582daf740f43a8bd4b4471a3c1a99a => generated 610 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:40.967679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7881649-4c4a-4409-89f2-14614c365366 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:40.968782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7881649-4c4a-4409-89f2-14614c365366 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:40.969262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7881649-4c4a-4409-89f2-14614c365366 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:40.971386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 130/269] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:40.977514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d157353-983a-40ef-86f1-af00c101fec3 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:40.978717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d157353-983a-40ef-86f1-af00c101fec3 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:40.979112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d157353-983a-40ef-86f1-af00c101fec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:40.998581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-3d157353-983a-40ef-86f1-af00c101fec3 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:40.999800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3d157353-983a-40ef-86f1-af00c101fec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:41.007785 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 140/270] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:40 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:41.032118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7881649-4c4a-4409-89f2-14614c365366 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.049091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7881649-4c4a-4409-89f2-14614c365366 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.053448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38980427-adc7-4221-ba04-beb6d4c57b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.054220 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980427-adc7-4221-ba04-beb6d4c57b8a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.054504 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980427-adc7-4221-ba04-beb6d4c57b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.054806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980427-adc7-4221-ba04-beb6d4c57b8a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.066281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38980427-adc7-4221-ba04-beb6d4c57b8a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:41.073828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-38980427-adc7-4221-ba04-beb6d4c57b8a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:41.075380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 131/271] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:41.080942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d157353-983a-40ef-86f1-af00c101fec3 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.090401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d157353-983a-40ef-86f1-af00c101fec3 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.094887 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb93a40-03a7-4c73-8467-6dd1bb4fd07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.095540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb93a40-03a7-4c73-8467-6dd1bb4fd07f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.095818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb93a40-03a7-4c73-8467-6dd1bb4fd07f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.096091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb93a40-03a7-4c73-8467-6dd1bb4fd07f admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.096852 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb93a40-03a7-4c73-8467-6dd1bb4fd07f admin admin] RBAC: Adding query filter params (name=member) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:41.097150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb93a40-03a7-4c73-8467-6dd1bb4fd07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.098713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb93a40-03a7-4c73-8467-6dd1bb4fd07f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.108477 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 141/272] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:41.114061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38980427-adc7-4221-ba04-beb6d4c57b8a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.125466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38980427-adc7-4221-ba04-beb6d4c57b8a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.130093 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73dbba-9ad9-424f-ae8e-a4384824ac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.131001 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73dbba-9ad9-424f-ae8e-a4384824ac3b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.131275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73dbba-9ad9-424f-ae8e-a4384824ac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.131541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73dbba-9ad9-424f-ae8e-a4384824ac3b admin admin] PATH_INFO: `/v3/users/c985ab1170464eeeb37d277d40af7392` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.132843 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73dbba-9ad9-424f-ae8e-a4384824ac3b admin admin] RBAC: Authorizing `identity:get_user(user_id=c985ab1170464eeeb37d277d40af7392)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.135684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73dbba-9ad9-424f-ae8e-a4384824ac3b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.137361 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 132/273] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/users/c985ab1170464eeeb37d277d40af7392 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:41.143010 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb93a40-03a7-4c73-8467-6dd1bb4fd07f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.153026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb93a40-03a7-4c73-8467-6dd1bb4fd07f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.160183 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5bb33-eb3f-4967-9d76-41399493f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.160814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5bb33-eb3f-4967-9d76-41399493f6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.161091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5bb33-eb3f-4967-9d76-41399493f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.161361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5bb33-eb3f-4967-9d76-41399493f6e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.169544 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5bb33-eb3f-4967-9d76-41399493f6e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.171312 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5bb33-eb3f-4967-9d76-41399493f6e2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.180238 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 142/274] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:41.187839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73dbba-9ad9-424f-ae8e-a4384824ac3b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.198232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73dbba-9ad9-424f-ae8e-a4384824ac3b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.202842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4946c4-9303-44c4-b5e3-09f5cd168a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.203679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4946c4-9303-44c4-b5e3-09f5cd168a65 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.203962 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4946c4-9303-44c4-b5e3-09f5cd168a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.204235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4946c4-9303-44c4-b5e3-09f5cd168a65 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.205437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4946c4-9303-44c4-b5e3-09f5cd168a65 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.207510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4946c4-9303-44c4-b5e3-09f5cd168a65 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.209438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 133/275] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:41.215321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5bb33-eb3f-4967-9d76-41399493f6e2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.224227 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5bb33-eb3f-4967-9d76-41399493f6e2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.228614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e8edd-bbbc-49a8-b1c5-7069765d9685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.229507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e8edd-bbbc-49a8-b1c5-7069765d9685 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.229786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e8edd-bbbc-49a8-b1c5-7069765d9685 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.230058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e8edd-bbbc-49a8-b1c5-7069765d9685 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.230946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e8edd-bbbc-49a8-b1c5-7069765d9685 admin admin] RBAC: Adding query filter params (role.id=42656495a54b4164862c9a31838a731e, scope.project.id=3a4097a2cc55405b80afdb315dd566fe, user.id=c985ab1170464eeeb37d277d40af7392) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:41.231251 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e8edd-bbbc-49a8-b1c5-7069765d9685 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.233073 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e8edd-bbbc-49a8-b1c5-7069765d9685 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.239336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 143/276] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/role_assignments?user.id=c985ab1170464eeeb37d277d40af7392&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=42656495a54b4164862c9a31838a731e => generated 610 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:41.240903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828df1-5809-40aa-ae69-65080c670547 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.241190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828df1-5809-40aa-ae69-65080c670547 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.241473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828df1-5809-40aa-ae69-65080c670547 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.244038 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 134/277] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:41.254203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d355-7ae5-4d74-89ae-f26b00cf1561 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.254856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d355-7ae5-4d74-89ae-f26b00cf1561 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.255332 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d355-7ae5-4d74-89ae-f26b00cf1561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.276634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-74a0d355-7ae5-4d74-89ae-f26b00cf1561 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:41.278244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-74a0d355-7ae5-4d74-89ae-f26b00cf1561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:41.286487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 144/278] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:41 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:41.303953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074068c1-8416-41d0-ac89-72eb796850f2 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.304284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074068c1-8416-41d0-ac89-72eb796850f2 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.304507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074068c1-8416-41d0-ac89-72eb796850f2 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.306903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 135/279] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:41.312928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddff33-14da-40d7-ae1f-7f556608a071 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.313233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddff33-14da-40d7-ae1f-7f556608a071 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.313485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddff33-14da-40d7-ae1f-7f556608a071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.315535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074068c1-8416-41d0-ac89-72eb796850f2 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.333830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074068c1-8416-41d0-ac89-72eb796850f2 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.334987 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-aeddff33-14da-40d7-ae1f-7f556608a071 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:41.336384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-aeddff33-14da-40d7-ae1f-7f556608a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:41.341874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3cb7b-2ad5-4809-b7d0-5af6ec943dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.343293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3cb7b-2ad5-4809-b7d0-5af6ec943dee admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.343802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3cb7b-2ad5-4809-b7d0-5af6ec943dee admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.344277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3cb7b-2ad5-4809-b7d0-5af6ec943dee admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.354780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 145/280] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:41 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:41.361098 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3cb7b-2ad5-4809-b7d0-5af6ec943dee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:41.368294 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-7eb3cb7b-2ad5-4809-b7d0-5af6ec943dee admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:41.369995 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 136/281] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:37:41.373693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddff33-14da-40d7-ae1f-7f556608a071 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.380365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3cb7b-2ad5-4809-b7d0-5af6ec943dee admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.383336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddff33-14da-40d7-ae1f-7f556608a071 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.388616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47f763-4b1d-4d51-acf7-fa8f9f28c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.389425 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47f763-4b1d-4d51-acf7-fa8f9f28c3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.389703 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47f763-4b1d-4d51-acf7-fa8f9f28c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.389969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47f763-4b1d-4d51-acf7-fa8f9f28c3c3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.393898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3cb7b-2ad5-4809-b7d0-5af6ec943dee admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.400338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24be30b-6417-43d4-b411-b80c19778abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.401331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24be30b-6417-43d4-b411-b80c19778abd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.401794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24be30b-6417-43d4-b411-b80c19778abd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.402066 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24be30b-6417-43d4-b411-b80c19778abd admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.402876 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24be30b-6417-43d4-b411-b80c19778abd admin admin] RBAC: Adding query filter params (name=member) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:41.402981 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47f763-4b1d-4d51-acf7-fa8f9f28c3c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:41.403184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24be30b-6417-43d4-b411-b80c19778abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.404802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24be30b-6417-43d4-b411-b80c19778abd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.409944 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-bc47f763-4b1d-4d51-acf7-fa8f9f28c3c3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 24 16:37:41.412309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 146/282] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:41.412461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bf441-8705-4eb6-bdfc-a232aa007ecc None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.412741 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bf441-8705-4eb6-bdfc-a232aa007ecc None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.413017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bf441-8705-4eb6-bdfc-a232aa007ecc None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.414692 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 147/283] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:41.415471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 137/284] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:41.417202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bf441-8705-4eb6-bdfc-a232aa007ecc None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.420868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24be30b-6417-43d4-b411-b80c19778abd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.431924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24be30b-6417-43d4-b411-b80c19778abd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.433239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bf441-8705-4eb6-bdfc-a232aa007ecc None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.437246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5184e-6885-4c83-868a-6f2b3b9f9c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.438048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ba693-e625-4f61-8023-7fee7bd9b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.438187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5184e-6885-4c83-868a-6f2b3b9f9c4a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.438369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5184e-6885-4c83-868a-6f2b3b9f9c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.438648 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5184e-6885-4c83-868a-6f2b3b9f9c4a admin admin] PATH_INFO: `/v3/users/5e7efe26cd054065888786c8dcdc0c0b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.438780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ba693-e625-4f61-8023-7fee7bd9b5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.438980 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ba693-e625-4f61-8023-7fee7bd9b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.439252 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ba693-e625-4f61-8023-7fee7bd9b5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.440006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ba693-e625-4f61-8023-7fee7bd9b5c5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:41.440310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ba693-e625-4f61-8023-7fee7bd9b5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.441896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ba693-e625-4f61-8023-7fee7bd9b5c5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.451465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 148/285] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:41.452945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f079a1a-9782-42dc-ae2b-307069d5ce48 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.453229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f079a1a-9782-42dc-ae2b-307069d5ce48 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.453520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f079a1a-9782-42dc-ae2b-307069d5ce48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.454694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5184e-6885-4c83-868a-6f2b3b9f9c4a admin admin] RBAC: Authorizing `identity:get_user(user_id=5e7efe26cd054065888786c8dcdc0c0b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.456953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5184e-6885-4c83-868a-6f2b3b9f9c4a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.458614 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 138/286] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/users/5e7efe26cd054065888786c8dcdc0c0b => generated 294 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:41.461412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5184e-6885-4c83-868a-6f2b3b9f9c4a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.473451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5184e-6885-4c83-868a-6f2b3b9f9c4a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.478695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ec656-95ba-4c22-b2b6-12c5f3136920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.479880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ec656-95ba-4c22-b2b6-12c5f3136920 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.480285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ec656-95ba-4c22-b2b6-12c5f3136920 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.480614 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ec656-95ba-4c22-b2b6-12c5f3136920 admin admin] PATH_INFO: `/v3/users/a356e57b73214c959bddd781dc528d7a` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.481164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-7f079a1a-9782-42dc-ae2b-307069d5ce48 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:41.481935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ec656-95ba-4c22-b2b6-12c5f3136920 admin admin] RBAC: Authorizing `identity:get_user(user_id=a356e57b73214c959bddd781dc528d7a)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.482361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7f079a1a-9782-42dc-ae2b-307069d5ce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:41.484251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ec656-95ba-4c22-b2b6-12c5f3136920 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.486167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 139/287] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/users/a356e57b73214c959bddd781dc528d7a => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:41.486998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ec656-95ba-4c22-b2b6-12c5f3136920 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.490020 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 149/288] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:41 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:41.492301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f079a1a-9782-42dc-ae2b-307069d5ce48 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.497222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ec656-95ba-4c22-b2b6-12c5f3136920 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.504499 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f079a1a-9782-42dc-ae2b-307069d5ce48 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.505249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262ba9e-d8fb-4c66-aebf-19336ba348bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.505974 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262ba9e-d8fb-4c66-aebf-19336ba348bf admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.506318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262ba9e-d8fb-4c66-aebf-19336ba348bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.506661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262ba9e-d8fb-4c66-aebf-19336ba348bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.507608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262ba9e-d8fb-4c66-aebf-19336ba348bf admin admin] RBAC: Adding query filter params (role.id=42656495a54b4164862c9a31838a731e, user.id=5e7efe26cd054065888786c8dcdc0c0b, scope.system=all) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:41.507982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262ba9e-d8fb-4c66-aebf-19336ba348bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.508897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38295a-4232-4aaf-86fd-45b9f8526701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.510520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38295a-4232-4aaf-86fd-45b9f8526701 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.510921 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38295a-4232-4aaf-86fd-45b9f8526701 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.511201 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262ba9e-d8fb-4c66-aebf-19336ba348bf admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.511475 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38295a-4232-4aaf-86fd-45b9f8526701 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.516988 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38295a-4232-4aaf-86fd-45b9f8526701 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.517560 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38295a-4232-4aaf-86fd-45b9f8526701 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.519543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 150/289] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:41.520238 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38295a-4232-4aaf-86fd-45b9f8526701 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.523756 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 140/290] 10.222.0.117 () {56 vars in 1334 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/role_assignments?user.id=5e7efe26cd054065888786c8dcdc0c0b&scope.system=all&role.id=42656495a54b4164862c9a31838a731e => generated 227 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:41.525518 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262ba9e-d8fb-4c66-aebf-19336ba348bf admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.530724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38295a-4232-4aaf-86fd-45b9f8526701 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.535351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e03108-cda8-433a-98be-f8097acff342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.536156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e03108-cda8-433a-98be-f8097acff342 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.536438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e03108-cda8-433a-98be-f8097acff342 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.536710 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e03108-cda8-433a-98be-f8097acff342 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.536838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262ba9e-d8fb-4c66-aebf-19336ba348bf admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.537949 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e03108-cda8-433a-98be-f8097acff342 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.539738 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e03108-cda8-433a-98be-f8097acff342 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.541466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 151/291] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:41 2022] GET /identity/v3/domains/default => generated 200 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:41.542075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfec20c-c709-41a1-a5e5-ac4e362fc408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.543320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec20c-c709-41a1-a5e5-ac4e362fc408 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.543603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec20c-c709-41a1-a5e5-ac4e362fc408 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.543870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec20c-c709-41a1-a5e5-ac4e362fc408 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe/users/a356e57b73214c959bddd781dc528d7a/roles/80ddcf60ec9a4fe5b64bf40d73fdd3b5` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.546307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfec20c-c709-41a1-a5e5-ac4e362fc408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4097a2cc55405b80afdb315dd566fe, user_id=a356e57b73214c959bddd781dc528d7a, role_id=80ddcf60ec9a4fe5b64bf40d73fdd3b5)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.547131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e03108-cda8-433a-98be-f8097acff342 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:41.549446 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfec20c-c709-41a1-a5e5-ac4e362fc408 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.557780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e03108-cda8-433a-98be-f8097acff342 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:41.565901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 141/292] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:37:41 2022] PUT /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe/users/a356e57b73214c959bddd781dc528d7a/roles/80ddcf60ec9a4fe5b64bf40d73fdd3b5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:37:41.623348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fc15f-1618-4c58-a17c-08fad83cc9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:41.624080 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fc15f-1618-4c58-a17c-08fad83cc9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:41.624360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fc15f-1618-4c58-a17c-08fad83cc9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:41.624631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fc15f-1618-4c58-a17c-08fad83cc9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:41.625393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fc15f-1618-4c58-a17c-08fad83cc9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:41.627535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fc15f-1618-4c58-a17c-08fad83cc9d6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:41.654803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 152/293] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:37:41 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:37:43.814231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ba48c-caf1-472b-bbda-a6d6a1ee8a46 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:43.814783 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ba48c-caf1-472b-bbda-a6d6a1ee8a46 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:43.814783 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ba48c-caf1-472b-bbda-a6d6a1ee8a46 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:43.816551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 142/294] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:43.822624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103bcb5-4e45-4496-be6a-e5a5976a961e None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:43.823236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103bcb5-4e45-4496-be6a-e5a5976a961e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:43.823236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103bcb5-4e45-4496-be6a-e5a5976a961e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:43.842217 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b103bcb5-4e45-4496-be6a-e5a5976a961e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:43.843476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b103bcb5-4e45-4496-be6a-e5a5976a961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:43.851883 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 153/295] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:43 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:43.875267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ba48c-caf1-472b-bbda-a6d6a1ee8a46 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:43.888546 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ba48c-caf1-472b-bbda-a6d6a1ee8a46 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:43.892874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ca54b-f186-4a3f-a17b-1b4c6809a1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:43.893653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ca54b-f186-4a3f-a17b-1b4c6809a1bf admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:43.893931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ca54b-f186-4a3f-a17b-1b4c6809a1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:43.894206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ca54b-f186-4a3f-a17b-1b4c6809a1bf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:43.902262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3c07d-6ad8-4861-93ac-4435b7956200 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:43.902540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3c07d-6ad8-4861-93ac-4435b7956200 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:43.902844 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3c07d-6ad8-4861-93ac-4435b7956200 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:43.904866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 154/296] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:43.910480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c8c8-a661-4dd6-b224-ac5a2312965b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:43.910788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c8c8-a661-4dd6-b224-ac5a2312965b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:43.911059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c8c8-a661-4dd6-b224-ac5a2312965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:43.915661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ca54b-f186-4a3f-a17b-1b4c6809a1bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:43.923908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-5a4ca54b-f186-4a3f-a17b-1b4c6809a1bf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:43.925447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 143/297] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:43.932480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5e62c8c8-a661-4dd6-b224-ac5a2312965b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:43.933111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ca54b-f186-4a3f-a17b-1b4c6809a1bf admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:43.933668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5e62c8c8-a661-4dd6-b224-ac5a2312965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:43.947004 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 155/298] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:43 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:43.947153 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ca54b-f186-4a3f-a17b-1b4c6809a1bf admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:43.950035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33af0ca-3758-421b-875e-403b042a61d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:43.950698 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33af0ca-3758-421b-875e-403b042a61d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:43.951019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33af0ca-3758-421b-875e-403b042a61d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:43.951301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33af0ca-3758-421b-875e-403b042a61d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:43.952077 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33af0ca-3758-421b-875e-403b042a61d8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:43.952388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33af0ca-3758-421b-875e-403b042a61d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:43.954020 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33af0ca-3758-421b-875e-403b042a61d8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:43.963790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 144/299] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:43 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:43.969511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c8c8-a661-4dd6-b224-ac5a2312965b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:43.973325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33af0ca-3758-421b-875e-403b042a61d8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:43.980874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c8c8-a661-4dd6-b224-ac5a2312965b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:43.983786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33af0ca-3758-421b-875e-403b042a61d8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:43.986331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd517c-3555-4ccc-9b51-125fbdd3afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:43.987590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd517c-3555-4ccc-9b51-125fbdd3afd8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:43.988193 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd517c-3555-4ccc-9b51-125fbdd3afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:43.988466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceddd3-45da-49dc-9869-f5b10e250b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:43.988909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd517c-3555-4ccc-9b51-125fbdd3afd8 admin admin] PATH_INFO: `/v3/users/5e7efe26cd054065888786c8dcdc0c0b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:43.989247 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceddd3-45da-49dc-9869-f5b10e250b1b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:43.989526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceddd3-45da-49dc-9869-f5b10e250b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:43.989801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceddd3-45da-49dc-9869-f5b10e250b1b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:43.991169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd517c-3555-4ccc-9b51-125fbdd3afd8 admin admin] RBAC: Authorizing `identity:get_user(user_id=5e7efe26cd054065888786c8dcdc0c0b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:43.994531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd517c-3555-4ccc-9b51-125fbdd3afd8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:43.996434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 156/300] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:43 2022] GET /identity/v3/users/5e7efe26cd054065888786c8dcdc0c0b => generated 294 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:44.002038 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd517c-3555-4ccc-9b51-125fbdd3afd8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.005928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceddd3-45da-49dc-9869-f5b10e250b1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:44.013612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd517c-3555-4ccc-9b51-125fbdd3afd8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.013744 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-abceddd3-45da-49dc-9869-f5b10e250b1b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 24 16:37:44.015134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 145/301] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:37:44.020730 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91dbf-4627-48ec-b515-2e996eb65843 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.021016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91dbf-4627-48ec-b515-2e996eb65843 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.021291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91dbf-4627-48ec-b515-2e996eb65843 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.022053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9448ffc-9d98-41b0-910e-4293e783b469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.022921 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448ffc-9d98-41b0-910e-4293e783b469 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.023019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 146/302] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:44.023379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448ffc-9d98-41b0-910e-4293e783b469 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.023480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448ffc-9d98-41b0-910e-4293e783b469 admin admin] PATH_INFO: `/v3/system/users/5e7efe26cd054065888786c8dcdc0c0b/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.023978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba91dbf-4627-48ec-b515-2e996eb65843 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.026173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9448ffc-9d98-41b0-910e-4293e783b469 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5e7efe26cd054065888786c8dcdc0c0b, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:44.027240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-f9448ffc-9d98-41b0-910e-4293e783b469 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:44.027240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:37:44.027240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:37:44.028138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9448ffc-9d98-41b0-910e-4293e783b469 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:44.038517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 157/303] 10.222.0.117 () {58 vars in 1360 bytes} [Mon Jan 24 16:37:44 2022] PUT /identity/v3/system/users/5e7efe26cd054065888786c8dcdc0c0b/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:37:44.046784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba91dbf-4627-48ec-b515-2e996eb65843 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.046990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0ba3-0d29-4784-9b1f-6a77edd10ba5 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.046990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0ba3-0d29-4784-9b1f-6a77edd10ba5 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.046990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0ba3-0d29-4784-9b1f-6a77edd10ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.051972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714b809-7e02-4a1c-a8c3-c355719822ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.052748 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714b809-7e02-4a1c-a8c3-c355719822ee admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.053030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714b809-7e02-4a1c-a8c3-c355719822ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.053340 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714b809-7e02-4a1c-a8c3-c355719822ee admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.054115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714b809-7e02-4a1c-a8c3-c355719822ee admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:44.054469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714b809-7e02-4a1c-a8c3-c355719822ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:44.056251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714b809-7e02-4a1c-a8c3-c355719822ee admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:44.070354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-6cba0ba3-0d29-4784-9b1f-6a77edd10ba5 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:44.072016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 147/304] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:44 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:44.072351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6cba0ba3-0d29-4784-9b1f-6a77edd10ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:44.073113 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714b809-7e02-4a1c-a8c3-c355719822ee admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.087929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714b809-7e02-4a1c-a8c3-c355719822ee admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.088115 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 158/305] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:44 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:44.098782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8119cf-9bd4-4081-98fe-e68dcf0927c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.098782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8119cf-9bd4-4081-98fe-e68dcf0927c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.098782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8119cf-9bd4-4081-98fe-e68dcf0927c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.098782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8119cf-9bd4-4081-98fe-e68dcf0927c5 admin admin] PATH_INFO: `/v3/users/a356e57b73214c959bddd781dc528d7a` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.099184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8119cf-9bd4-4081-98fe-e68dcf0927c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=a356e57b73214c959bddd781dc528d7a)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:44.101709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8119cf-9bd4-4081-98fe-e68dcf0927c5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:44.101709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 148/306] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:44 2022] GET /identity/v3/users/a356e57b73214c959bddd781dc528d7a => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:44.108620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba0ba3-0d29-4784-9b1f-6a77edd10ba5 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.111853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8119cf-9bd4-4081-98fe-e68dcf0927c5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.118841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba0ba3-0d29-4784-9b1f-6a77edd10ba5 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.123158 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8119cf-9bd4-4081-98fe-e68dcf0927c5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.123467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a15f6-0843-4ee5-9465-9291bfbd38b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.124133 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a15f6-0843-4ee5-9465-9291bfbd38b2 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.124411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a15f6-0843-4ee5-9465-9291bfbd38b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.124688 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a15f6-0843-4ee5-9465-9291bfbd38b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.128934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d46405-b754-43e2-9c1c-5eeb27bff1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.130046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d46405-b754-43e2-9c1c-5eeb27bff1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.130589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d46405-b754-43e2-9c1c-5eeb27bff1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.131117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d46405-b754-43e2-9c1c-5eeb27bff1d2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.137092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a15f6-0843-4ee5-9465-9291bfbd38b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:44.139039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a15f6-0843-4ee5-9465-9291bfbd38b2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:44.144320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d46405-b754-43e2-9c1c-5eeb27bff1d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:44.148849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 159/307] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:44 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:44.152640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-75d46405-b754-43e2-9c1c-5eeb27bff1d2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 24 16:37:44.159087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a15f6-0843-4ee5-9465-9291bfbd38b2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.159446 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 149/308] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:44.161567 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d46405-b754-43e2-9c1c-5eeb27bff1d2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.167411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a15f6-0843-4ee5-9465-9291bfbd38b2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.171920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a38b8-72f2-4a00-abcd-54a790a0239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.172786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a38b8-72f2-4a00-abcd-54a790a0239c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.173060 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a38b8-72f2-4a00-abcd-54a790a0239c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.173325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a38b8-72f2-4a00-abcd-54a790a0239c admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.174563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a38b8-72f2-4a00-abcd-54a790a0239c admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:44.174673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d46405-b754-43e2-9c1c-5eeb27bff1d2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.177125 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a38b8-72f2-4a00-abcd-54a790a0239c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:44.179651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 160/309] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:44 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:44.180055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d643179-aca0-4925-bf2c-61b2ddaa7fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.181684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d643179-aca0-4925-bf2c-61b2ddaa7fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.182803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d643179-aca0-4925-bf2c-61b2ddaa7fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.183292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d643179-aca0-4925-bf2c-61b2ddaa7fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.184302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d643179-aca0-4925-bf2c-61b2ddaa7fc0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:44.184836 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d643179-aca0-4925-bf2c-61b2ddaa7fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:44.186467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a38b8-72f2-4a00-abcd-54a790a0239c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.187093 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d643179-aca0-4925-bf2c-61b2ddaa7fc0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:44.197068 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a38b8-72f2-4a00-abcd-54a790a0239c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.202155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408fbe8-9693-4b2a-a8be-e7869899578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.202569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 150/310] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:44 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:44.202675 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fbe8-9693-4b2a-a8be-e7869899578d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.203043 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fbe8-9693-4b2a-a8be-e7869899578d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.203284 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fbe8-9693-4b2a-a8be-e7869899578d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.204145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408fbe8-9693-4b2a-a8be-e7869899578d admin admin] RBAC: Adding query filter params (role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5, scope.project.id=3a4097a2cc55405b80afdb315dd566fe, user.id=a356e57b73214c959bddd781dc528d7a) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:44.204452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408fbe8-9693-4b2a-a8be-e7869899578d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:44.204852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d643179-aca0-4925-bf2c-61b2ddaa7fc0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.206443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408fbe8-9693-4b2a-a8be-e7869899578d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:44.213607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 161/311] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:37:44 2022] GET /identity/v3/role_assignments?user.id=a356e57b73214c959bddd781dc528d7a&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5 => generated 610 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:44.216404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d643179-aca0-4925-bf2c-61b2ddaa7fc0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.225545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f5dce-ade5-4a0f-96db-900a02e069ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.226817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f5dce-ade5-4a0f-96db-900a02e069ee admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.227307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f5dce-ade5-4a0f-96db-900a02e069ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.227912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f5dce-ade5-4a0f-96db-900a02e069ee admin admin] PATH_INFO: `/v3/users/b47bce7c35854a8a889e834a9a1fd40b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.229871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b00f8-f9d3-440b-8a04-5e4090127a7e None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.230159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b00f8-f9d3-440b-8a04-5e4090127a7e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.230431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b00f8-f9d3-440b-8a04-5e4090127a7e None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.232235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 162/312] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:37:44.238356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67f7a-d682-45ed-807c-b5a8c7942f1b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.238627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67f7a-d682-45ed-807c-b5a8c7942f1b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.238936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67f7a-d682-45ed-807c-b5a8c7942f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.245793 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f5dce-ade5-4a0f-96db-900a02e069ee admin admin] RBAC: Authorizing `identity:get_user(user_id=b47bce7c35854a8a889e834a9a1fd40b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:44.248058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f5dce-ade5-4a0f-96db-900a02e069ee admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:44.249823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 151/313] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:44 2022] GET /identity/v3/users/b47bce7c35854a8a889e834a9a1fd40b => generated 294 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:44.256076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f5dce-ade5-4a0f-96db-900a02e069ee admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.260519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-aed67f7a-d682-45ed-807c-b5a8c7942f1b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:44.261736 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-aed67f7a-d682-45ed-807c-b5a8c7942f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:44.267383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f5dce-ade5-4a0f-96db-900a02e069ee admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.270992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 163/314] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:44 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:44.273085 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba70d7-a461-431d-b44d-412d7b3ba3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.274160 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba70d7-a461-431d-b44d-412d7b3ba3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.274683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba70d7-a461-431d-b44d-412d7b3ba3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.275189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba70d7-a461-431d-b44d-412d7b3ba3e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.276428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba70d7-a461-431d-b44d-412d7b3ba3e3 admin admin] RBAC: Adding query filter params (role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5, user.id=b47bce7c35854a8a889e834a9a1fd40b, scope.system=all) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:44.276952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba70d7-a461-431d-b44d-412d7b3ba3e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:44.279106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba70d7-a461-431d-b44d-412d7b3ba3e3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:44.285216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 152/315] 10.222.0.117 () {56 vars in 1334 bytes} [Mon Jan 24 16:37:44 2022] GET /identity/v3/role_assignments?user.id=b47bce7c35854a8a889e834a9a1fd40b&scope.system=all&role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5 => generated 227 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:44.296885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed67f7a-d682-45ed-807c-b5a8c7942f1b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.307704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed67f7a-d682-45ed-807c-b5a8c7942f1b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.312480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83ead3-c3d7-43f2-9fbe-cb0385372d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.313301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83ead3-c3d7-43f2-9fbe-cb0385372d0e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.313631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83ead3-c3d7-43f2-9fbe-cb0385372d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.313899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83ead3-c3d7-43f2-9fbe-cb0385372d0e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.315352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83ead3-c3d7-43f2-9fbe-cb0385372d0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:44.317222 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83ead3-c3d7-43f2-9fbe-cb0385372d0e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:44.319564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 164/316] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:44.326218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba70d7-a461-431d-b44d-412d7b3ba3e3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:44.341919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba70d7-a461-431d-b44d-412d7b3ba3e3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:44.347805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a40e3-fc94-4f60-93be-b0e39d26e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:44.348553 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a40e3-fc94-4f60-93be-b0e39d26e26c admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:44.348838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a40e3-fc94-4f60-93be-b0e39d26e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:44.349115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a40e3-fc94-4f60-93be-b0e39d26e26c admin admin] PATH_INFO: `/v3/groups` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:44.349936 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a40e3-fc94-4f60-93be-b0e39d26e26c admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:44.351297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-525a40e3-fc94-4f60-93be-b0e39d26e26c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:44.351297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:37:44.351297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:37:44.353498 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a40e3-fc94-4f60-93be-b0e39d26e26c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:44.373863 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 153/317] 10.222.0.117 () {60 vars in 1160 bytes} [Mon Jan 24 16:37:44 2022] POST /identity/v3/groups => generated 230 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:37:46.311395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9cab5-7c27-4232-b900-1ebf9770c9de None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.312017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9cab5-7c27-4232-b900-1ebf9770c9de None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.312017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9cab5-7c27-4232-b900-1ebf9770c9de None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.313983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 165/318] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:46.319582 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23bd00-9097-4ee0-a5c9-568896a071c7 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.320371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23bd00-9097-4ee0-a5c9-568896a071c7 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.320646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23bd00-9097-4ee0-a5c9-568896a071c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.338453 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-de23bd00-9097-4ee0-a5c9-568896a071c7 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:46.339661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-de23bd00-9097-4ee0-a5c9-568896a071c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:46.347166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 154/319] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:46 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:46.372209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9cab5-7c27-4232-b900-1ebf9770c9de None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:46.385488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9cab5-7c27-4232-b900-1ebf9770c9de None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:46.390078 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd26a45-07ca-4ed8-b4b8-0277c8ca0fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:46.390922 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd26a45-07ca-4ed8-b4b8-0277c8ca0fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.391207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd26a45-07ca-4ed8-b4b8-0277c8ca0fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.391481 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd26a45-07ca-4ed8-b4b8-0277c8ca0fc8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.403285 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd26a45-07ca-4ed8-b4b8-0277c8ca0fc8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:46.410276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-2dd26a45-07ca-4ed8-b4b8-0277c8ca0fc8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:46.411658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 166/320] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:37:46.417330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23bd00-9097-4ee0-a5c9-568896a071c7 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:46.427082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23bd00-9097-4ee0-a5c9-568896a071c7 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:46.431897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b51a4-f52d-4390-a9b2-e14f79fd16c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:46.432556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b51a4-f52d-4390-a9b2-e14f79fd16c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.432835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b51a4-f52d-4390-a9b2-e14f79fd16c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.433112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b51a4-f52d-4390-a9b2-e14f79fd16c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.433876 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b51a4-f52d-4390-a9b2-e14f79fd16c5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:46.434182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b51a4-f52d-4390-a9b2-e14f79fd16c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:46.435822 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b51a4-f52d-4390-a9b2-e14f79fd16c5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:46.444185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 155/321] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:46 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:46.450053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd26a45-07ca-4ed8-b4b8-0277c8ca0fc8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:46.460193 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd26a45-07ca-4ed8-b4b8-0277c8ca0fc8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:46.464641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650f48f-15c9-4030-bb28-adbf53b191e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:46.465474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f48f-15c9-4030-bb28-adbf53b191e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.465751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f48f-15c9-4030-bb28-adbf53b191e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.466017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f48f-15c9-4030-bb28-adbf53b191e2 admin admin] PATH_INFO: `/v3/users/5e7efe26cd054065888786c8dcdc0c0b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.467231 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650f48f-15c9-4030-bb28-adbf53b191e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=5e7efe26cd054065888786c8dcdc0c0b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:46.469318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650f48f-15c9-4030-bb28-adbf53b191e2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:46.471048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 167/322] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:46 2022] GET /identity/v3/users/5e7efe26cd054065888786c8dcdc0c0b => generated 294 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:46.476610 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b51a4-f52d-4390-a9b2-e14f79fd16c5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:46.486488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b51a4-f52d-4390-a9b2-e14f79fd16c5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:46.490651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595aae3-8bad-4792-b641-11b7fd5d5288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:46.491322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595aae3-8bad-4792-b641-11b7fd5d5288 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.491598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595aae3-8bad-4792-b641-11b7fd5d5288 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.491929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595aae3-8bad-4792-b641-11b7fd5d5288 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.492698 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595aae3-8bad-4792-b641-11b7fd5d5288 admin admin] RBAC: Adding query filter params (role.id=42656495a54b4164862c9a31838a731e, user.id=5e7efe26cd054065888786c8dcdc0c0b, scope.system=all) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:46.493618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595aae3-8bad-4792-b641-11b7fd5d5288 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:46.495403 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595aae3-8bad-4792-b641-11b7fd5d5288 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:46.511161 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 156/323] 10.222.0.117 () {56 vars in 1334 bytes} [Mon Jan 24 16:37:46 2022] GET /identity/v3/role_assignments?user.id=5e7efe26cd054065888786c8dcdc0c0b&scope.system=all&role.id=42656495a54b4164862c9a31838a731e => generated 512 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:46.540424 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25092c-070f-4d5f-b317-ab5959177d61 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.540761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25092c-070f-4d5f-b317-ab5959177d61 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.541065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25092c-070f-4d5f-b317-ab5959177d61 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.542974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 168/324] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:46.549083 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9d82-5d03-41af-8bc1-5a40ebca3eb0 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.549370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9d82-5d03-41af-8bc1-5a40ebca3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.549635 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9d82-5d03-41af-8bc1-5a40ebca3eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.568960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-744c9d82-5d03-41af-8bc1-5a40ebca3eb0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:46.570161 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-744c9d82-5d03-41af-8bc1-5a40ebca3eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:46.578249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 157/325] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:46 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:46.600564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25092c-070f-4d5f-b317-ab5959177d61 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:46.614799 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25092c-070f-4d5f-b317-ab5959177d61 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:46.620602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f8171-1c44-457b-87a3-c2c0f7fb369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:46.621406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f8171-1c44-457b-87a3-c2c0f7fb369d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.621686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f8171-1c44-457b-87a3-c2c0f7fb369d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.621955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f8171-1c44-457b-87a3-c2c0f7fb369d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.630459 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf6c1-b997-4f5a-bb99-59a33746780a None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.630822 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf6c1-b997-4f5a-bb99-59a33746780a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.631049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf6c1-b997-4f5a-bb99-59a33746780a None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.632925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 158/326] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:37:46.635146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f8171-1c44-457b-87a3-c2c0f7fb369d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:46.638928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc997713-4a00-41ee-8515-58ee1462a6c4 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.639212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc997713-4a00-41ee-8515-58ee1462a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.639476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc997713-4a00-41ee-8515-58ee1462a6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.642277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-664f8171-1c44-457b-87a3-c2c0f7fb369d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 24 16:37:46.643699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 169/327] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:46.649939 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f8171-1c44-457b-87a3-c2c0f7fb369d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:46.658341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-dc997713-4a00-41ee-8515-58ee1462a6c4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:46.659600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dc997713-4a00-41ee-8515-58ee1462a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:46.659716 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f8171-1c44-457b-87a3-c2c0f7fb369d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:46.664113 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eccc3d-52be-4b71-a527-aca5d1ef2795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:46.664739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eccc3d-52be-4b71-a527-aca5d1ef2795 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.665527 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eccc3d-52be-4b71-a527-aca5d1ef2795 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.665856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eccc3d-52be-4b71-a527-aca5d1ef2795 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.666569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eccc3d-52be-4b71-a527-aca5d1ef2795 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:46.666926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eccc3d-52be-4b71-a527-aca5d1ef2795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:46.668295 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 159/328] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:46 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:46.668511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eccc3d-52be-4b71-a527-aca5d1ef2795 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:46.678787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 170/329] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:46 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:46.684450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc997713-4a00-41ee-8515-58ee1462a6c4 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:46.691985 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eccc3d-52be-4b71-a527-aca5d1ef2795 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:46.693900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc997713-4a00-41ee-8515-58ee1462a6c4 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:46.698481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdbb9e-08a3-4141-95ea-8ac00efea674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:46.699380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdbb9e-08a3-4141-95ea-8ac00efea674 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.699662 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdbb9e-08a3-4141-95ea-8ac00efea674 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.699938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdbb9e-08a3-4141-95ea-8ac00efea674 admin admin] PATH_INFO: `/v3/users/b47bce7c35854a8a889e834a9a1fd40b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.701344 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdbb9e-08a3-4141-95ea-8ac00efea674 admin admin] RBAC: Authorizing `identity:get_user(user_id=b47bce7c35854a8a889e834a9a1fd40b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:46.702376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eccc3d-52be-4b71-a527-aca5d1ef2795 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:46.703862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdbb9e-08a3-4141-95ea-8ac00efea674 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:46.705600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 160/330] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:46 2022] GET /identity/v3/users/b47bce7c35854a8a889e834a9a1fd40b => generated 294 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:46.706863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d60399-4787-42a2-9479-e7dcaded99c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:46.707626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d60399-4787-42a2-9479-e7dcaded99c0 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.707905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d60399-4787-42a2-9479-e7dcaded99c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.708171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d60399-4787-42a2-9479-e7dcaded99c0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.709342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d60399-4787-42a2-9479-e7dcaded99c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:46.711031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d60399-4787-42a2-9479-e7dcaded99c0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:46.711152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdbb9e-08a3-4141-95ea-8ac00efea674 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:46.712637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 171/331] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:37:46 2022] GET /identity/v3/domains/default => generated 200 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:46.717781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d60399-4787-42a2-9479-e7dcaded99c0 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:46.721938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdbb9e-08a3-4141-95ea-8ac00efea674 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:46.726965 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d60399-4787-42a2-9479-e7dcaded99c0 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:46.727170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc682-1c77-45f8-bd5a-942962c43a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:46.728774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc682-1c77-45f8-bd5a-942962c43a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.729070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc682-1c77-45f8-bd5a-942962c43a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.729338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc682-1c77-45f8-bd5a-942962c43a33 admin admin] PATH_INFO: `/v3/system/users/b47bce7c35854a8a889e834a9a1fd40b/roles/80ddcf60ec9a4fe5b64bf40d73fdd3b5` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.730819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc682-1c77-45f8-bd5a-942962c43a33 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b47bce7c35854a8a889e834a9a1fd40b, role_id=80ddcf60ec9a4fe5b64bf40d73fdd3b5)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:46.731850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-389cc682-1c77-45f8-bd5a-942962c43a33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:46.731850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:37:46.731850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:37:46.732236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debadb4-c54b-476b-8b09-0353a3c7ab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:46.732725 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc682-1c77-45f8-bd5a-942962c43a33 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:46.732881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debadb4-c54b-476b-8b09-0353a3c7ab07 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:46.733123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debadb4-c54b-476b-8b09-0353a3c7ab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:46.733395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debadb4-c54b-476b-8b09-0353a3c7ab07 admin admin] PATH_INFO: `/v3/groups` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:46.734064 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debadb4-c54b-476b-8b09-0353a3c7ab07 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:46.735104 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-5debadb4-c54b-476b-8b09-0353a3c7ab07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:46.735104 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:37:46.735104 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:37:46.736257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debadb4-c54b-476b-8b09-0353a3c7ab07 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:46.742583 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 161/332] 10.222.0.117 () {58 vars in 1360 bytes} [Mon Jan 24 16:37:46 2022] PUT /identity/v3/system/users/b47bce7c35854a8a889e834a9a1fd40b/roles/80ddcf60ec9a4fe5b64bf40d73fdd3b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:37:46.751105 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 172/333] 10.222.0.117 () {60 vars in 1160 bytes} [Mon Jan 24 16:37:46 2022] POST /identity/v3/groups => generated 227 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:37:49.469229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776713-5f9e-4a3d-a984-79f6488cfacf None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.470101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776713-5f9e-4a3d-a984-79f6488cfacf None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.470557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776713-5f9e-4a3d-a984-79f6488cfacf None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.473055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 162/334] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:49 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:49.483954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c533004-e566-4aeb-83d1-8066be447e9a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.484821 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c533004-e566-4aeb-83d1-8066be447e9a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.485305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c533004-e566-4aeb-83d1-8066be447e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.511781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4c533004-e566-4aeb-83d1-8066be447e9a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:49.513267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4c533004-e566-4aeb-83d1-8066be447e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:49.521851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 173/335] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:49 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:49.553813 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776713-5f9e-4a3d-a984-79f6488cfacf None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:49.572607 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776713-5f9e-4a3d-a984-79f6488cfacf None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:49.577765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1aef9-b120-4dca-888d-2c29c36a1574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:49.578781 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1aef9-b120-4dca-888d-2c29c36a1574 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.579245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1aef9-b120-4dca-888d-2c29c36a1574 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.579717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1aef9-b120-4dca-888d-2c29c36a1574 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.593596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee358c-281d-4497-96a3-cf906ffaf158 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.594151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee358c-281d-4497-96a3-cf906ffaf158 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.594605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee358c-281d-4497-96a3-cf906ffaf158 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.596586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 174/336] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:37:49.597840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7d7cd-6680-4c1b-8fff-a24aeb398071 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.598325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7d7cd-6680-4c1b-8fff-a24aeb398071 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.598792 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7d7cd-6680-4c1b-8fff-a24aeb398071 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.600544 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 175/337] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:49.602709 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff28d7-e31f-4e4e-9a5b-4c7e84dec1e5 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.603053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff28d7-e31f-4e4e-9a5b-4c7e84dec1e5 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.603670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff28d7-e31f-4e4e-9a5b-4c7e84dec1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.604307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a1aef9-b120-4dca-888d-2c29c36a1574 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:49.613659 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-e0a1aef9-b120-4dca-888d-2c29c36a1574 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 24 16:37:49.615420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 163/338] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:49.618490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72799-33d7-4998-8424-2e3405a38fee None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.619185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72799-33d7-4998-8424-2e3405a38fee None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.619645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72799-33d7-4998-8424-2e3405a38fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.637459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-83ff28d7-e31f-4e4e-9a5b-4c7e84dec1e5 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:49.638643 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-83ff28d7-e31f-4e4e-9a5b-4c7e84dec1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:49.645492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-eeb72799-33d7-4998-8424-2e3405a38fee None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:49.648716 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-eeb72799-33d7-4998-8424-2e3405a38fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:49.659416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 176/339] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:49 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:49.660277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff28d7-e31f-4e4e-9a5b-4c7e84dec1e5 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:49.669647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 164/340] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:49 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:49.675708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff28d7-e31f-4e4e-9a5b-4c7e84dec1e5 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:49.684213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fc752-bdba-4693-9cc0-95a10015bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:49.684878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fc752-bdba-4693-9cc0-95a10015bfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.685154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fc752-bdba-4693-9cc0-95a10015bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.685423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fc752-bdba-4693-9cc0-95a10015bfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.686187 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fc752-bdba-4693-9cc0-95a10015bfe7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:49.686489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fc752-bdba-4693-9cc0-95a10015bfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:49.688107 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fc752-bdba-4693-9cc0-95a10015bfe7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:49.702599 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 177/341] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:49 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:49.708153 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72799-33d7-4998-8424-2e3405a38fee None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:49.716069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fc752-bdba-4693-9cc0-95a10015bfe7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:49.719016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72799-33d7-4998-8424-2e3405a38fee None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:49.730381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b1e7a-d756-446a-b52c-2b1d5a117e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:49.733143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b1e7a-d756-446a-b52c-2b1d5a117e35 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.733431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b1e7a-d756-446a-b52c-2b1d5a117e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.733708 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b1e7a-d756-446a-b52c-2b1d5a117e35 admin admin] PATH_INFO: `/v3/users/b47bce7c35854a8a889e834a9a1fd40b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.735201 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b1e7a-d756-446a-b52c-2b1d5a117e35 admin admin] RBAC: Authorizing `identity:get_user(user_id=b47bce7c35854a8a889e834a9a1fd40b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:49.737358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b1e7a-d756-446a-b52c-2b1d5a117e35 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:49.740752 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fc752-bdba-4693-9cc0-95a10015bfe7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:49.741812 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 165/342] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:37:49 2022] GET /identity/v3/users/b47bce7c35854a8a889e834a9a1fd40b => generated 294 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:49.743130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b1e7a-d756-446a-b52c-2b1d5a117e35 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:49.748601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9467db7-cd85-438e-983d-cd9dcb695d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:49.749416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9467db7-cd85-438e-983d-cd9dcb695d2f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.750617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9467db7-cd85-438e-983d-cd9dcb695d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.750943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9467db7-cd85-438e-983d-cd9dcb695d2f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.763114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b1e7a-d756-446a-b52c-2b1d5a117e35 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:49.770574 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9467db7-cd85-438e-983d-cd9dcb695d2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:49.778362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ce02f-d4ea-46b8-95dd-0de02532b79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:49.779174 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce02f-d4ea-46b8-95dd-0de02532b79f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.779451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce02f-d4ea-46b8-95dd-0de02532b79f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.779720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce02f-d4ea-46b8-95dd-0de02532b79f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.782880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-c9467db7-cd85-438e-983d-cd9dcb695d2f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:49.784091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 178/343] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:49.791614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9467db7-cd85-438e-983d-cd9dcb695d2f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:49.804736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ce02f-d4ea-46b8-95dd-0de02532b79f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:49.811853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-929ce02f-d4ea-46b8-95dd-0de02532b79f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:49.813067 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 166/344] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:49.815797 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9467db7-cd85-438e-983d-cd9dcb695d2f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:49.817023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ce02f-d4ea-46b8-95dd-0de02532b79f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:49.826681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e5c67-5852-4555-a3e4-16a0a0e6ba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:49.827479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e5c67-5852-4555-a3e4-16a0a0e6ba2a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.827763 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e5c67-5852-4555-a3e4-16a0a0e6ba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.828032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e5c67-5852-4555-a3e4-16a0a0e6ba2a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.828906 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e5c67-5852-4555-a3e4-16a0a0e6ba2a admin admin] RBAC: Adding query filter params (role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5, user.id=b47bce7c35854a8a889e834a9a1fd40b, scope.system=all) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:49.829214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e5c67-5852-4555-a3e4-16a0a0e6ba2a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:49.831176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e5c67-5852-4555-a3e4-16a0a0e6ba2a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:49.843012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ce02f-d4ea-46b8-95dd-0de02532b79f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:49.856226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccbefa-86af-4b78-86e7-698d461eb491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:49.856891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccbefa-86af-4b78-86e7-698d461eb491 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.857168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccbefa-86af-4b78-86e7-698d461eb491 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.857437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccbefa-86af-4b78-86e7-698d461eb491 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.858200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccbefa-86af-4b78-86e7-698d461eb491 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:49.858501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccbefa-86af-4b78-86e7-698d461eb491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:49.860131 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccbefa-86af-4b78-86e7-698d461eb491 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:49.869537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 179/345] 10.222.0.117 () {56 vars in 1334 bytes} [Mon Jan 24 16:37:49 2022] GET /identity/v3/role_assignments?user.id=b47bce7c35854a8a889e834a9a1fd40b&scope.system=all&role.id=80ddcf60ec9a4fe5b64bf40d73fdd3b5 => generated 512 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:49.870512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e5c67-5852-4555-a3e4-16a0a0e6ba2a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:49.878640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 167/346] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:49 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:49.885069 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccbefa-86af-4b78-86e7-698d461eb491 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:49.885616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e5c67-5852-4555-a3e4-16a0a0e6ba2a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:49.896387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c10f1-1f3b-4dd9-858e-bdc4bd677433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:49.897078 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c10f1-1f3b-4dd9-858e-bdc4bd677433 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.897357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c10f1-1f3b-4dd9-858e-bdc4bd677433 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.897631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c10f1-1f3b-4dd9-858e-bdc4bd677433 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.898413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c10f1-1f3b-4dd9-858e-bdc4bd677433 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:49.898717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c10f1-1f3b-4dd9-858e-bdc4bd677433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:49.900545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccbefa-86af-4b78-86e7-698d461eb491 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:49.900978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c10f1-1f3b-4dd9-858e-bdc4bd677433 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:49.914356 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121464ed-c5fb-4937-939a-70256eaed572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:49.915483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121464ed-c5fb-4937-939a-70256eaed572 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.916042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121464ed-c5fb-4937-939a-70256eaed572 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.916543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121464ed-c5fb-4937-939a-70256eaed572 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.925099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 180/347] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:49 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:49.931269 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c10f1-1f3b-4dd9-858e-bdc4bd677433 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:49.932986 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121464ed-c5fb-4937-939a-70256eaed572 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:49.935023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121464ed-c5fb-4937-939a-70256eaed572 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:49.953602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c10f1-1f3b-4dd9-858e-bdc4bd677433 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:49.955933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 168/348] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:49 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:37:49.961958 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121464ed-c5fb-4937-939a-70256eaed572 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:49.962270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54808f74-04cb-437c-8f43-f9f839e1aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:49.962963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54808f74-04cb-437c-8f43-f9f839e1aa86 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.963248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54808f74-04cb-437c-8f43-f9f839e1aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.963522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54808f74-04cb-437c-8f43-f9f839e1aa86 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.973049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121464ed-c5fb-4937-939a-70256eaed572 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:49.983752 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54808f74-04cb-437c-8f43-f9f839e1aa86 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:49.985707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54808f74-04cb-437c-8f43-f9f839e1aa86 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:49.986972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643b329-4cb4-47b9-a4f8-8761ee37bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:49.988109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643b329-4cb4-47b9-a4f8-8761ee37bc6c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:49.988597 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643b329-4cb4-47b9-a4f8-8761ee37bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:49.989071 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643b329-4cb4-47b9-a4f8-8761ee37bc6c admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:49.994166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643b329-4cb4-47b9-a4f8-8761ee37bc6c admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:49.997385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643b329-4cb4-47b9-a4f8-8761ee37bc6c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:49.999927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 169/349] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:49 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:50.003373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 181/350] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:49 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:50.009525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643b329-4cb4-47b9-a4f8-8761ee37bc6c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:50.010234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54808f74-04cb-437c-8f43-f9f839e1aa86 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:50.020712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643b329-4cb4-47b9-a4f8-8761ee37bc6c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:50.026952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54808f74-04cb-437c-8f43-f9f839e1aa86 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:50.032306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266570ef-d09a-41c7-87e5-7fba95eb402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:50.033172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266570ef-d09a-41c7-87e5-7fba95eb402b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.033449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266570ef-d09a-41c7-87e5-7fba95eb402b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.033724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266570ef-d09a-41c7-87e5-7fba95eb402b admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.035386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266570ef-d09a-41c7-87e5-7fba95eb402b admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:50.037423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266570ef-d09a-41c7-87e5-7fba95eb402b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:50.039130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 170/351] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:50 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:50.044120 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd78cf4-2a0b-4b04-bd6e-a91318f7c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:50.044983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd78cf4-2a0b-4b04-bd6e-a91318f7c1bf admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.045256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd78cf4-2a0b-4b04-bd6e-a91318f7c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.045523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd78cf4-2a0b-4b04-bd6e-a91318f7c1bf admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.048638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266570ef-d09a-41c7-87e5-7fba95eb402b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:50.057845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd78cf4-2a0b-4b04-bd6e-a91318f7c1bf admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:50.058912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-efd78cf4-2a0b-4b04-bd6e-a91318f7c1bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:50.058912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:37:50.058912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:37:50.060109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd78cf4-2a0b-4b04-bd6e-a91318f7c1bf admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:50.061763 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 182/352] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:50 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:50.068316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd78cf4-2a0b-4b04-bd6e-a91318f7c1bf admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:50.077146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266570ef-d09a-41c7-87e5-7fba95eb402b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:50.086417 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555e8b8-ed3d-4dc4-8470-a92ab6708de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:50.087365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555e8b8-ed3d-4dc4-8470-a92ab6708de3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.087641 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555e8b8-ed3d-4dc4-8470-a92ab6708de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.087912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555e8b8-ed3d-4dc4-8470-a92ab6708de3 admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.090522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd78cf4-2a0b-4b04-bd6e-a91318f7c1bf admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:50.091808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555e8b8-ed3d-4dc4-8470-a92ab6708de3 admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:50.092853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-1555e8b8-ed3d-4dc4-8470-a92ab6708de3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:37:50.092853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:37:50.092853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:37:50.094011 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555e8b8-ed3d-4dc4-8470-a92ab6708de3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:50.095632 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 171/353] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:50 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:50.102014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555e8b8-ed3d-4dc4-8470-a92ab6708de3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:50.110376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edc6c0-c7b0-414c-81a5-5a24557f54bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:50.111080 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc6c0-c7b0-414c-81a5-5a24557f54bd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.111356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc6c0-c7b0-414c-81a5-5a24557f54bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.111624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc6c0-c7b0-414c-81a5-5a24557f54bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.112479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edc6c0-c7b0-414c-81a5-5a24557f54bd admin admin] RBAC: Adding query filter params (group.id=88669d1a3690401ebfc46baa9d6fc72e, role.id=2d582daf740f43a8bd4b4471a3c1a99a, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:50.112768 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edc6c0-c7b0-414c-81a5-5a24557f54bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:50.114590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edc6c0-c7b0-414c-81a5-5a24557f54bd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:50.129313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555e8b8-ed3d-4dc4-8470-a92ab6708de3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:50.129846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 183/354] 10.222.0.117 () {56 vars in 1402 bytes} [Mon Jan 24 16:37:50 2022] GET /identity/v3/role_assignments?group.id=88669d1a3690401ebfc46baa9d6fc72e&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=2d582daf740f43a8bd4b4471a3c1a99a => generated 261 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:50.145676 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0e404-eba0-4b4e-acdc-520b99291337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:50.146346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0e404-eba0-4b4e-acdc-520b99291337 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.146720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0e404-eba0-4b4e-acdc-520b99291337 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.147100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0e404-eba0-4b4e-acdc-520b99291337 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.147959 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0e404-eba0-4b4e-acdc-520b99291337 admin admin] RBAC: Adding query filter params (group.id=88669d1a3690401ebfc46baa9d6fc72e, role.id=42656495a54b4164862c9a31838a731e, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:50.148322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0e404-eba0-4b4e-acdc-520b99291337 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:50.151197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0e404-eba0-4b4e-acdc-520b99291337 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:50.163030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 172/355] 10.222.0.117 () {56 vars in 1402 bytes} [Mon Jan 24 16:37:50 2022] GET /identity/v3/role_assignments?group.id=88669d1a3690401ebfc46baa9d6fc72e&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=42656495a54b4164862c9a31838a731e => generated 261 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:50.256654 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b9a1f-4154-4569-9981-da70ff3e163f None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.256948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b9a1f-4154-4569-9981-da70ff3e163f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.257104 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b9a1f-4154-4569-9981-da70ff3e163f None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.259092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 184/356] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:50.265185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42f518-8afe-43e9-83f9-e63d111f34fe None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.265553 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42f518-8afe-43e9-83f9-e63d111f34fe None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.265834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42f518-8afe-43e9-83f9-e63d111f34fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.295950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ac42f518-8afe-43e9-83f9-e63d111f34fe None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:50.297252 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ac42f518-8afe-43e9-83f9-e63d111f34fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:50.305571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 173/357] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:50 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:50.345331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b9a1f-4154-4569-9981-da70ff3e163f None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:50.359361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b9a1f-4154-4569-9981-da70ff3e163f None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:50.364862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279eb58-2768-427b-bbdf-f335a1c8ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:50.365730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279eb58-2768-427b-bbdf-f335a1c8ab54 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.366005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279eb58-2768-427b-bbdf-f335a1c8ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.366330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279eb58-2768-427b-bbdf-f335a1c8ab54 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.381506 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279eb58-2768-427b-bbdf-f335a1c8ab54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:50.389546 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-3279eb58-2768-427b-bbdf-f335a1c8ab54 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:50.391096 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 185/358] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:50.397250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42f518-8afe-43e9-83f9-e63d111f34fe None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:50.410776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42f518-8afe-43e9-83f9-e63d111f34fe None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:50.419623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd79c0-60c8-4c97-acc5-df69efc2b36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:50.420312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd79c0-60c8-4c97-acc5-df69efc2b36d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.420594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd79c0-60c8-4c97-acc5-df69efc2b36d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.420865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd79c0-60c8-4c97-acc5-df69efc2b36d admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.421650 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd79c0-60c8-4c97-acc5-df69efc2b36d admin admin] RBAC: Adding query filter params (name=member) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:50.421965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd79c0-60c8-4c97-acc5-df69efc2b36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:50.423624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd79c0-60c8-4c97-acc5-df69efc2b36d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:50.437588 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 174/359] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:50 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:50.443498 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279eb58-2768-427b-bbdf-f335a1c8ab54 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:50.454857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279eb58-2768-427b-bbdf-f335a1c8ab54 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:50.460325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bd564-e3b9-4f54-b938-b524f888c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:50.461321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bd564-e3b9-4f54-b938-b524f888c61c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.461911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bd564-e3b9-4f54-b938-b524f888c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.462416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bd564-e3b9-4f54-b938-b524f888c61c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.472214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bd564-e3b9-4f54-b938-b524f888c61c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:50.474340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bd564-e3b9-4f54-b938-b524f888c61c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:50.488235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 186/360] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:50 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:50.495407 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd79c0-60c8-4c97-acc5-df69efc2b36d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:50.506084 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd79c0-60c8-4c97-acc5-df69efc2b36d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:50.511219 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759cf3-4334-4c69-b140-af762e743a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:50.512362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759cf3-4334-4c69-b140-af762e743a85 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.512855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759cf3-4334-4c69-b140-af762e743a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.513363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759cf3-4334-4c69-b140-af762e743a85 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.514979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59759cf3-4334-4c69-b140-af762e743a85 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:50.517297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59759cf3-4334-4c69-b140-af762e743a85 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:50.519213 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 175/361] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:50 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:50.525024 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bd564-e3b9-4f54-b938-b524f888c61c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:50.534671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bd564-e3b9-4f54-b938-b524f888c61c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:50.541605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe5c6e-30bb-4a65-b220-79f87028c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:50.542783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe5c6e-30bb-4a65-b220-79f87028c283 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.543383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe5c6e-30bb-4a65-b220-79f87028c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.543932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe5c6e-30bb-4a65-b220-79f87028c283 admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.545453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe5c6e-30bb-4a65-b220-79f87028c283 admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:50.547771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe5c6e-30bb-4a65-b220-79f87028c283 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:50.549934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 187/362] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:50 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:50.556454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759cf3-4334-4c69-b140-af762e743a85 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:50.575522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759cf3-4334-4c69-b140-af762e743a85 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:50.582823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147afb42-9810-4942-899d-91c63d77191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:50.583489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147afb42-9810-4942-899d-91c63d77191e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:50.583770 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147afb42-9810-4942-899d-91c63d77191e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:50.584009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147afb42-9810-4942-899d-91c63d77191e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:50.584865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147afb42-9810-4942-899d-91c63d77191e admin admin] RBAC: Adding query filter params (group.id=88669d1a3690401ebfc46baa9d6fc72e, role.id=42656495a54b4164862c9a31838a731e, scope.project.id=3a4097a2cc55405b80afdb315dd566fe) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:50.585172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147afb42-9810-4942-899d-91c63d77191e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:50.587841 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147afb42-9810-4942-899d-91c63d77191e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:50.599305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 176/363] 10.222.0.117 () {56 vars in 1402 bytes} [Mon Jan 24 16:37:50 2022] GET /identity/v3/role_assignments?group.id=88669d1a3690401ebfc46baa9d6fc72e&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=42656495a54b4164862c9a31838a731e => generated 261 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:51.485059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cd9be-1ff3-4b23-a33a-b2c1eb900512 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:51.485751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cd9be-1ff3-4b23-a33a-b2c1eb900512 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:51.486266 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cd9be-1ff3-4b23-a33a-b2c1eb900512 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:51.488294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 188/364] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:51.495174 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc84176-0c64-4b39-a1cb-15a3c0bbd166 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:51.495783 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc84176-0c64-4b39-a1cb-15a3c0bbd166 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:51.496697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc84176-0c64-4b39-a1cb-15a3c0bbd166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:51.519153 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-3cc84176-0c64-4b39-a1cb-15a3c0bbd166 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:51.520661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3cc84176-0c64-4b39-a1cb-15a3c0bbd166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:51.533536 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 177/365] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:51 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:51.577378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cd9be-1ff3-4b23-a33a-b2c1eb900512 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:51.594650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cd9be-1ff3-4b23-a33a-b2c1eb900512 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:51.599972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27faec79-d714-46dc-a172-edd7c0ee1bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:51.601129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faec79-d714-46dc-a172-edd7c0ee1bbb admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:51.601617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faec79-d714-46dc-a172-edd7c0ee1bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:51.602167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faec79-d714-46dc-a172-edd7c0ee1bbb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:51.618482 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27faec79-d714-46dc-a172-edd7c0ee1bbb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:51.626214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-27faec79-d714-46dc-a172-edd7c0ee1bbb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:51.627989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 189/366] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:51.634203 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc84176-0c64-4b39-a1cb-15a3c0bbd166 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:51.647687 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc84176-0c64-4b39-a1cb-15a3c0bbd166 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:51.658668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9381b-11c8-45fd-9f64-3d67242daa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:51.659375 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9381b-11c8-45fd-9f64-3d67242daa1a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:51.659655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9381b-11c8-45fd-9f64-3d67242daa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:51.659927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9381b-11c8-45fd-9f64-3d67242daa1a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:51.660702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9381b-11c8-45fd-9f64-3d67242daa1a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:51.661004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9381b-11c8-45fd-9f64-3d67242daa1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:51.662614 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9381b-11c8-45fd-9f64-3d67242daa1a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:51.674616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 178/367] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:51 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:51.679955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27faec79-d714-46dc-a172-edd7c0ee1bbb admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:51.693999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27faec79-d714-46dc-a172-edd7c0ee1bbb admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:51.704595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee0ece-f77a-4037-b951-1b3292841eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:51.705596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0ece-f77a-4037-b951-1b3292841eee admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:51.706087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0ece-f77a-4037-b951-1b3292841eee admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:51.706613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0ece-f77a-4037-b951-1b3292841eee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:51.716896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee0ece-f77a-4037-b951-1b3292841eee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:51.719069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee0ece-f77a-4037-b951-1b3292841eee admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:51.731336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 190/368] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:51 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:51.736707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9381b-11c8-45fd-9f64-3d67242daa1a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:51.752768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9381b-11c8-45fd-9f64-3d67242daa1a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:51.763155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9eb62c-80a8-48de-ac74-e40cc937c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:51.764001 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb62c-80a8-48de-ac74-e40cc937c9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:51.764276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb62c-80a8-48de-ac74-e40cc937c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:51.764549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb62c-80a8-48de-ac74-e40cc937c9e6 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:51.767516 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9eb62c-80a8-48de-ac74-e40cc937c9e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:51.769575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9eb62c-80a8-48de-ac74-e40cc937c9e6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:51.771329 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 179/369] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:51 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:51.777443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee0ece-f77a-4037-b951-1b3292841eee admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:51.787348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee0ece-f77a-4037-b951-1b3292841eee admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:51.796366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fa72e-d2fb-4ac1-bd79-ae6cde2f52dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:51.797622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa72e-d2fb-4ac1-bd79-ae6cde2f52dd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:51.798121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa72e-d2fb-4ac1-bd79-ae6cde2f52dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:51.798646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa72e-d2fb-4ac1-bd79-ae6cde2f52dd admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:51.800254 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fa72e-d2fb-4ac1-bd79-ae6cde2f52dd admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:51.802545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fa72e-d2fb-4ac1-bd79-ae6cde2f52dd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:51.804664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 191/370] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:51 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:51.811240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9eb62c-80a8-48de-ac74-e40cc937c9e6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:51.827889 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9eb62c-80a8-48de-ac74-e40cc937c9e6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:51.833192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a689528-fa2c-409a-91b3-bfc63b4c488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:51.833831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689528-fa2c-409a-91b3-bfc63b4c488d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:51.834109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689528-fa2c-409a-91b3-bfc63b4c488d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:51.834378 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689528-fa2c-409a-91b3-bfc63b4c488d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:51.835257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a689528-fa2c-409a-91b3-bfc63b4c488d admin admin] RBAC: Adding query filter params (group.id=88669d1a3690401ebfc46baa9d6fc72e, role.id=2d582daf740f43a8bd4b4471a3c1a99a, scope.project.id=3a4097a2cc55405b80afdb315dd566fe) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:51.835563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a689528-fa2c-409a-91b3-bfc63b4c488d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:51.837737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a689528-fa2c-409a-91b3-bfc63b4c488d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:51.840019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df06ee-8126-4c17-9540-d97cbff7a834 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:51.840582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df06ee-8126-4c17-9540-d97cbff7a834 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:51.841101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df06ee-8126-4c17-9540-d97cbff7a834 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:51.843398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 192/371] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:51 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:37:51.848268 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebdfe-2ed1-4744-a7a8-2317bd00284a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:51.848554 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebdfe-2ed1-4744-a7a8-2317bd00284a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:51.848823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebdfe-2ed1-4744-a7a8-2317bd00284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:51.849014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 180/372] 10.222.0.117 () {56 vars in 1402 bytes} [Mon Jan 24 16:37:51 2022] GET /identity/v3/role_assignments?group.id=88669d1a3690401ebfc46baa9d6fc72e&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=2d582daf740f43a8bd4b4471a3c1a99a => generated 261 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:51.891949 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-7c4ebdfe-2ed1-4744-a7a8-2317bd00284a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:51.893167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7c4ebdfe-2ed1-4744-a7a8-2317bd00284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:51.905549 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 193/373] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:51 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:51.952332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a689528-fa2c-409a-91b3-bfc63b4c488d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:51.968560 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a689528-fa2c-409a-91b3-bfc63b4c488d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:51.974152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea096323-980b-440f-9741-6e550ae0ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:51.975005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096323-980b-440f-9741-6e550ae0ab9d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:51.975285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096323-980b-440f-9741-6e550ae0ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:51.975552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096323-980b-440f-9741-6e550ae0ab9d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:51.996784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea096323-980b-440f-9741-6e550ae0ab9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:52.003688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-ea096323-980b-440f-9741-6e550ae0ab9d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:52.005273 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 181/374] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:52.011473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ebdfe-2ed1-4744-a7a8-2317bd00284a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:52.027003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ebdfe-2ed1-4744-a7a8-2317bd00284a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:52.040557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e88c22-5d7b-46b8-9348-925d47ef1029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:52.041234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e88c22-5d7b-46b8-9348-925d47ef1029 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:52.041509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e88c22-5d7b-46b8-9348-925d47ef1029 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:52.041777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e88c22-5d7b-46b8-9348-925d47ef1029 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:52.042543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e88c22-5d7b-46b8-9348-925d47ef1029 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:52.042866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e88c22-5d7b-46b8-9348-925d47ef1029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:52.044464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e88c22-5d7b-46b8-9348-925d47ef1029 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:52.065203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 194/375] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:52 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:52.071639 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea096323-980b-440f-9741-6e550ae0ab9d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:52.089143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea096323-980b-440f-9741-6e550ae0ab9d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:52.099177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0da85-0cb9-4672-b910-d181626afc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:52.099838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0da85-0cb9-4672-b910-d181626afc5f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:52.100117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0da85-0cb9-4672-b910-d181626afc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:52.100389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0da85-0cb9-4672-b910-d181626afc5f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:52.110735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0da85-0cb9-4672-b910-d181626afc5f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:52.112497 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0da85-0cb9-4672-b910-d181626afc5f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:52.124695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 182/376] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:52 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:52.130208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e88c22-5d7b-46b8-9348-925d47ef1029 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:52.156781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e88c22-5d7b-46b8-9348-925d47ef1029 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:52.164369 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81372c50-f82f-4286-a430-bf0120bcf251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:52.165660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81372c50-f82f-4286-a430-bf0120bcf251 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:52.166144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81372c50-f82f-4286-a430-bf0120bcf251 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:52.166622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81372c50-f82f-4286-a430-bf0120bcf251 admin admin] PATH_INFO: `/v3/projects/6e0f1fba09874be8ae22b37e033b5e57` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:52.168041 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81372c50-f82f-4286-a430-bf0120bcf251 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e0f1fba09874be8ae22b37e033b5e57)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:52.170011 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81372c50-f82f-4286-a430-bf0120bcf251 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:52.172772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 195/377] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:52 2022] GET /identity/v3/projects/6e0f1fba09874be8ae22b37e033b5e57 => generated 345 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:52.177548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0da85-0cb9-4672-b910-d181626afc5f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:52.192371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0da85-0cb9-4672-b910-d181626afc5f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:52.200693 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cb22f-9335-4984-8705-7e975fcb4527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:52.201557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cb22f-9335-4984-8705-7e975fcb4527 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:52.201830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cb22f-9335-4984-8705-7e975fcb4527 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:52.202100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cb22f-9335-4984-8705-7e975fcb4527 admin admin] PATH_INFO: `/v3/groups/b563051dbc164226ab84dc9a2a66a754` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:52.216245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cb22f-9335-4984-8705-7e975fcb4527 admin admin] RBAC: Authorizing `identity:get_group(group_id=b563051dbc164226ab84dc9a2a66a754)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:52.218162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cb22f-9335-4984-8705-7e975fcb4527 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:52.219849 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 183/378] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:52 2022] GET /identity/v3/groups/b563051dbc164226ab84dc9a2a66a754 => generated 230 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:52.225524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81372c50-f82f-4286-a430-bf0120bcf251 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:52.240206 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81372c50-f82f-4286-a430-bf0120bcf251 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:52.250472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c84fde-8646-4132-b343-dc8a5265cd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:52.251497 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c84fde-8646-4132-b343-dc8a5265cd42 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:52.251982 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c84fde-8646-4132-b343-dc8a5265cd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:52.252453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c84fde-8646-4132-b343-dc8a5265cd42 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:52.253511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c84fde-8646-4132-b343-dc8a5265cd42 admin admin] RBAC: Adding query filter params (group.id=b563051dbc164226ab84dc9a2a66a754, role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=6e0f1fba09874be8ae22b37e033b5e57) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:52.254013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c84fde-8646-4132-b343-dc8a5265cd42 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:52.256086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c84fde-8646-4132-b343-dc8a5265cd42 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:52.267327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 196/379] 10.222.0.117 () {56 vars in 1402 bytes} [Mon Jan 24 16:37:52 2022] GET /identity/v3/role_assignments?group.id=b563051dbc164226ab84dc9a2a66a754&scope.project.id=6e0f1fba09874be8ae22b37e033b5e57&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 261 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:52.835482 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090799-3d69-4ef4-afbe-846777c7c40f None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:52.836019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090799-3d69-4ef4-afbe-846777c7c40f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:52.836019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090799-3d69-4ef4-afbe-846777c7c40f None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:52.837968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 184/380] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:52.843514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6efb-28aa-4d10-9519-6510f13cee80 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:52.844343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6efb-28aa-4d10-9519-6510f13cee80 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:52.844830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6efb-28aa-4d10-9519-6510f13cee80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:52.866655 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-341e6efb-28aa-4d10-9519-6510f13cee80 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:52.868783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-341e6efb-28aa-4d10-9519-6510f13cee80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:52.880739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 197/381] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:52 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:52.928293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90090799-3d69-4ef4-afbe-846777c7c40f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:52.944558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90090799-3d69-4ef4-afbe-846777c7c40f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:52.954290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbc827-a970-4486-a019-5b68f0bc9210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:52.955170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbc827-a970-4486-a019-5b68f0bc9210 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:52.955450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbc827-a970-4486-a019-5b68f0bc9210 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:52.955719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbc827-a970-4486-a019-5b68f0bc9210 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:52.971659 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbc827-a970-4486-a019-5b68f0bc9210 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:52.979086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-5edbc827-a970-4486-a019-5b68f0bc9210 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:52.980290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 185/382] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:52.986296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e6efb-28aa-4d10-9519-6510f13cee80 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:52.999742 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e6efb-28aa-4d10-9519-6510f13cee80 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.010917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa7d6d-6de1-4018-b0fd-e8b3aae3e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.011858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7d6d-6de1-4018-b0fd-e8b3aae3e583 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.012337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7d6d-6de1-4018-b0fd-e8b3aae3e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.012803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7d6d-6de1-4018-b0fd-e8b3aae3e583 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.013759 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa7d6d-6de1-4018-b0fd-e8b3aae3e583 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:53.014276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa7d6d-6de1-4018-b0fd-e8b3aae3e583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.016130 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa7d6d-6de1-4018-b0fd-e8b3aae3e583 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.029302 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 198/383] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:52 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:53.035056 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbc827-a970-4486-a019-5b68f0bc9210 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.050218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbc827-a970-4486-a019-5b68f0bc9210 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.059331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406de625-e284-4301-85ff-d730a9715e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.060177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406de625-e284-4301-85ff-d730a9715e04 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.060454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406de625-e284-4301-85ff-d730a9715e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.060726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406de625-e284-4301-85ff-d730a9715e04 admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.067482 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406de625-e284-4301-85ff-d730a9715e04 admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.069405 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406de625-e284-4301-85ff-d730a9715e04 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.072051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 186/384] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:53 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:53.077605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa7d6d-6de1-4018-b0fd-e8b3aae3e583 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.092046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa7d6d-6de1-4018-b0fd-e8b3aae3e583 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.103155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dbb3b-9286-4c4a-849e-95555cee0f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.104276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbb3b-9286-4c4a-849e-95555cee0f09 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.104560 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbb3b-9286-4c4a-849e-95555cee0f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.104838 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbb3b-9286-4c4a-849e-95555cee0f09 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.111534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dbb3b-9286-4c4a-849e-95555cee0f09 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.113620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dbb3b-9286-4c4a-849e-95555cee0f09 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.115349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 199/385] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:53 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:53.121792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406de625-e284-4301-85ff-d730a9715e04 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.135544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406de625-e284-4301-85ff-d730a9715e04 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.148255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0d582-d838-4c56-8cc6-dd3bbc5e40cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.149370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0d582-d838-4c56-8cc6-dd3bbc5e40cd admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.149809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0d582-d838-4c56-8cc6-dd3bbc5e40cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.150145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0d582-d838-4c56-8cc6-dd3bbc5e40cd admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/groups/88669d1a3690401ebfc46baa9d6fc72e/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.155107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0d582-d838-4c56-8cc6-dd3bbc5e40cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3035a30a67154f908dd0a8d0bd3d5b2b, group_id=88669d1a3690401ebfc46baa9d6fc72e, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.158804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0d582-d838-4c56-8cc6-dd3bbc5e40cd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.186627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 187/386] 10.222.0.117 () {58 vars in 1468 bytes} [Mon Jan 24 16:37:53 2022] PUT /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/groups/88669d1a3690401ebfc46baa9d6fc72e/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:37:53.232143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ef433-6d24-4a9e-97cd-fa4ec7d9b885 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.232445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ef433-6d24-4a9e-97cd-fa4ec7d9b885 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.232702 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ef433-6d24-4a9e-97cd-fa4ec7d9b885 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.234896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 200/387] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:53.240303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b742c-0d24-4757-9efe-85d62aa9a96b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.240585 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b742c-0d24-4757-9efe-85d62aa9a96b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.240861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b742c-0d24-4757-9efe-85d62aa9a96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.264905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a48b742c-0d24-4757-9efe-85d62aa9a96b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:53.266117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a48b742c-0d24-4757-9efe-85d62aa9a96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:53.345792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 188/388] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:53 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:53.387572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ef433-6d24-4a9e-97cd-fa4ec7d9b885 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.404540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ef433-6d24-4a9e-97cd-fa4ec7d9b885 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.408959 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc6108-4349-4c2a-b376-7e48b44e0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.409758 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc6108-4349-4c2a-b376-7e48b44e0ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.410039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc6108-4349-4c2a-b376-7e48b44e0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.410311 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc6108-4349-4c2a-b376-7e48b44e0ce9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.424684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1ede8-97eb-4939-8591-839916ca4968 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.424981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1ede8-97eb-4939-8591-839916ca4968 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.425622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1ede8-97eb-4939-8591-839916ca4968 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.427592 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 189/389] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:37:53.429549 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc6108-4349-4c2a-b376-7e48b44e0ce9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:53.433440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2fa7-29ea-49c7-914c-0646575e2f39 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.433734 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2fa7-29ea-49c7-914c-0646575e2f39 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.434013 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2fa7-29ea-49c7-914c-0646575e2f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.437153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-2acc6108-4349-4c2a-b376-7e48b44e0ce9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:53.438670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 201/390] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:53.444260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc6108-4349-4c2a-b376-7e48b44e0ce9 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.465673 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc6108-4349-4c2a-b376-7e48b44e0ce9 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.470136 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-19ee2fa7-29ea-49c7-914c-0646575e2f39 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:53.471357 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-19ee2fa7-29ea-49c7-914c-0646575e2f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:53.473264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839d848-ddd8-452e-bbf3-059e1455881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.473926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839d848-ddd8-452e-bbf3-059e1455881d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.474210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839d848-ddd8-452e-bbf3-059e1455881d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.474465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839d848-ddd8-452e-bbf3-059e1455881d admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.475299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839d848-ddd8-452e-bbf3-059e1455881d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:53.475605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839d848-ddd8-452e-bbf3-059e1455881d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.478091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839d848-ddd8-452e-bbf3-059e1455881d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.480183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 190/391] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:53 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:53.491681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 202/392] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:53 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:53.497632 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2fa7-29ea-49c7-914c-0646575e2f39 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.505607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839d848-ddd8-452e-bbf3-059e1455881d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.509592 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2fa7-29ea-49c7-914c-0646575e2f39 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.517815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839d848-ddd8-452e-bbf3-059e1455881d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.519834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582689-1dda-445c-aeed-b0b5c528ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.520683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582689-1dda-445c-aeed-b0b5c528ef00 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.520961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582689-1dda-445c-aeed-b0b5c528ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.521232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582689-1dda-445c-aeed-b0b5c528ef00 admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.522758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35582689-1dda-445c-aeed-b0b5c528ef00 admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.524945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35582689-1dda-445c-aeed-b0b5c528ef00 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.526546 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 191/393] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:53 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:53.533838 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120df0b-b0bb-4988-8ff3-fe281f34f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.534638 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120df0b-b0bb-4988-8ff3-fe281f34f064 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.534936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120df0b-b0bb-4988-8ff3-fe281f34f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.535201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120df0b-b0bb-4988-8ff3-fe281f34f064 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.539900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582689-1dda-445c-aeed-b0b5c528ef00 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.549777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120df0b-b0bb-4988-8ff3-fe281f34f064 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:53.550619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582689-1dda-445c-aeed-b0b5c528ef00 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.558473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fb83c-5cb8-4a8c-940f-fa1feead20f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.558993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-7120df0b-b0bb-4988-8ff3-fe281f34f064 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:53.559409 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fb83c-5cb8-4a8c-940f-fa1feead20f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.559685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fb83c-5cb8-4a8c-940f-fa1feead20f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.560010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fb83c-5cb8-4a8c-940f-fa1feead20f2 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.561272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fb83c-5cb8-4a8c-940f-fa1feead20f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.561755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 203/394] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:53.566625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fb83c-5cb8-4a8c-940f-fa1feead20f2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.566625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 192/395] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:53 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:53.567864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120df0b-b0bb-4988-8ff3-fe281f34f064 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.571624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fb83c-5cb8-4a8c-940f-fa1feead20f2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.581077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120df0b-b0bb-4988-8ff3-fe281f34f064 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.581765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fb83c-5cb8-4a8c-940f-fa1feead20f2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.587692 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd32d-df1a-4221-ae84-710da3f2067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.588693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd32d-df1a-4221-ae84-710da3f2067e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.589073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158c4d7-e7bf-4dbd-848a-d4aa59091e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.589431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd32d-df1a-4221-ae84-710da3f2067e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.589903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd32d-df1a-4221-ae84-710da3f2067e admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.590014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158c4d7-e7bf-4dbd-848a-d4aa59091e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.590253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158c4d7-e7bf-4dbd-848a-d4aa59091e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.590527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158c4d7-e7bf-4dbd-848a-d4aa59091e22 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/groups/88669d1a3690401ebfc46baa9d6fc72e/roles/2d582daf740f43a8bd4b4471a3c1a99a` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.591518 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd32d-df1a-4221-ae84-710da3f2067e admin admin] RBAC: Adding query filter params (name=member) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:53.592124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd32d-df1a-4221-ae84-710da3f2067e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.593285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158c4d7-e7bf-4dbd-848a-d4aa59091e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3035a30a67154f908dd0a8d0bd3d5b2b, group_id=88669d1a3690401ebfc46baa9d6fc72e, role_id=2d582daf740f43a8bd4b4471a3c1a99a)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.594281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd32d-df1a-4221-ae84-710da3f2067e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.601205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158c4d7-e7bf-4dbd-848a-d4aa59091e22 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.605793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 204/396] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:53 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:53.613855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd32d-df1a-4221-ae84-710da3f2067e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.618146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 193/397] 10.222.0.117 () {58 vars in 1468 bytes} [Mon Jan 24 16:37:53 2022] PUT /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b/groups/88669d1a3690401ebfc46baa9d6fc72e/roles/2d582daf740f43a8bd4b4471a3c1a99a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:37:53.626539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd32d-df1a-4221-ae84-710da3f2067e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.697650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971a0c6-016e-4687-9fc6-283572055380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.699119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971a0c6-016e-4687-9fc6-283572055380 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.699697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971a0c6-016e-4687-9fc6-283572055380 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.700176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971a0c6-016e-4687-9fc6-283572055380 admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.701900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971a0c6-016e-4687-9fc6-283572055380 admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.704384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971a0c6-016e-4687-9fc6-283572055380 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.706868 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 205/398] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:53 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:53.714338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158c4d7-e7bf-4dbd-848a-d4aa59091e22 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.737040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158c4d7-e7bf-4dbd-848a-d4aa59091e22 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.751572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb7342-3130-4123-a44d-daf8d3a82e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.752449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb7342-3130-4123-a44d-daf8d3a82e93 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.752724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb7342-3130-4123-a44d-daf8d3a82e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.752998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb7342-3130-4123-a44d-daf8d3a82e93 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.754308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb7342-3130-4123-a44d-daf8d3a82e93 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.756367 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb7342-3130-4123-a44d-daf8d3a82e93 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.758562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 194/399] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:53 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:53.763945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971a0c6-016e-4687-9fc6-283572055380 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:53.774620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971a0c6-016e-4687-9fc6-283572055380 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:53.779616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde4514-bc77-467f-a875-5e54213c8a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:53.780533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde4514-bc77-467f-a875-5e54213c8a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:53.780812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde4514-bc77-467f-a875-5e54213c8a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:53.781080 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde4514-bc77-467f-a875-5e54213c8a49 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe/groups/88669d1a3690401ebfc46baa9d6fc72e/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:53.783211 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde4514-bc77-467f-a875-5e54213c8a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4097a2cc55405b80afdb315dd566fe, group_id=88669d1a3690401ebfc46baa9d6fc72e, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:53.785934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde4514-bc77-467f-a875-5e54213c8a49 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:53.806663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 206/400] 10.222.0.117 () {58 vars in 1468 bytes} [Mon Jan 24 16:37:53 2022] PUT /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe/groups/88669d1a3690401ebfc46baa9d6fc72e/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:37:55.026279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd173d60-2ec1-4062-978a-16c94e844ec3 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.026856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd173d60-2ec1-4062-978a-16c94e844ec3 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.026856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd173d60-2ec1-4062-978a-16c94e844ec3 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.028883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 195/401] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:55.041331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f555b6-d198-4176-9129-052b35ca4cc9 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.041876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f555b6-d198-4176-9129-052b35ca4cc9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.041876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f555b6-d198-4176-9129-052b35ca4cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.072599 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-65f555b6-d198-4176-9129-052b35ca4cc9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:55.073930 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-65f555b6-d198-4176-9129-052b35ca4cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:55.153213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 207/402] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:55 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:55.209522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd173d60-2ec1-4062-978a-16c94e844ec3 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:55.230230 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd173d60-2ec1-4062-978a-16c94e844ec3 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:55.236571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983d1bd-a731-4359-a5e8-debb1f8d1f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:55.237393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983d1bd-a731-4359-a5e8-debb1f8d1f48 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.237669 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983d1bd-a731-4359-a5e8-debb1f8d1f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.237938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983d1bd-a731-4359-a5e8-debb1f8d1f48 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.262771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983d1bd-a731-4359-a5e8-debb1f8d1f48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:55.274074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-3983d1bd-a731-4359-a5e8-debb1f8d1f48 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:55.276190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 196/403] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:55.281762 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f555b6-d198-4176-9129-052b35ca4cc9 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:55.292509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f555b6-d198-4176-9129-052b35ca4cc9 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:55.302902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff4c9e-dc27-405c-b894-369803da326b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:55.303571 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff4c9e-dc27-405c-b894-369803da326b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.303851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff4c9e-dc27-405c-b894-369803da326b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.304128 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff4c9e-dc27-405c-b894-369803da326b admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.304992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff4c9e-dc27-405c-b894-369803da326b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:55.305879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff4c9e-dc27-405c-b894-369803da326b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:55.307594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff4c9e-dc27-405c-b894-369803da326b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:55.320539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 208/404] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:55 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:55.326181 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983d1bd-a731-4359-a5e8-debb1f8d1f48 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:55.338646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983d1bd-a731-4359-a5e8-debb1f8d1f48 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:55.346029 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6509b0e-64f6-421b-9dba-5a8f92849d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:55.346965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509b0e-64f6-421b-9dba-5a8f92849d79 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.347246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509b0e-64f6-421b-9dba-5a8f92849d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.347521 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509b0e-64f6-421b-9dba-5a8f92849d79 admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.348798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6509b0e-64f6-421b-9dba-5a8f92849d79 admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:55.350775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6509b0e-64f6-421b-9dba-5a8f92849d79 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:55.354024 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 197/405] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:55 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:55.360200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff4c9e-dc27-405c-b894-369803da326b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:55.371328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff4c9e-dc27-405c-b894-369803da326b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:55.379101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe305f5-82da-411a-9dad-a088f6196ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:55.379988 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe305f5-82da-411a-9dad-a088f6196ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.380275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe305f5-82da-411a-9dad-a088f6196ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.380550 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe305f5-82da-411a-9dad-a088f6196ad7 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.381807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe305f5-82da-411a-9dad-a088f6196ad7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:55.384715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe305f5-82da-411a-9dad-a088f6196ad7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:55.386847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 209/406] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:55 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:55.392304 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6509b0e-64f6-421b-9dba-5a8f92849d79 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:55.403530 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6509b0e-64f6-421b-9dba-5a8f92849d79 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:55.409088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45077ae3-d672-497f-8a09-87a6037440f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:55.410003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077ae3-d672-497f-8a09-87a6037440f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.410330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077ae3-d672-497f-8a09-87a6037440f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.410609 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077ae3-d672-497f-8a09-87a6037440f8 admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe/groups/88669d1a3690401ebfc46baa9d6fc72e/roles/2d582daf740f43a8bd4b4471a3c1a99a` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.413486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45077ae3-d672-497f-8a09-87a6037440f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4097a2cc55405b80afdb315dd566fe, group_id=88669d1a3690401ebfc46baa9d6fc72e, role_id=2d582daf740f43a8bd4b4471a3c1a99a)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:55.416868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45077ae3-d672-497f-8a09-87a6037440f8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:55.438281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 198/407] 10.222.0.117 () {58 vars in 1468 bytes} [Mon Jan 24 16:37:55 2022] PUT /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe/groups/88669d1a3690401ebfc46baa9d6fc72e/roles/2d582daf740f43a8bd4b4471a3c1a99a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:37:55.528740 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17163c3c-5d87-45a5-ac09-dc5a8c6caa41 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.529081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17163c3c-5d87-45a5-ac09-dc5a8c6caa41 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.529349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17163c3c-5d87-45a5-ac09-dc5a8c6caa41 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.531513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 210/408] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:55.537333 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63edd03-4c5b-4fb8-96f0-04f5a4a7ae79 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.537646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63edd03-4c5b-4fb8-96f0-04f5a4a7ae79 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.537881 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63edd03-4c5b-4fb8-96f0-04f5a4a7ae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.565348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e63edd03-4c5b-4fb8-96f0-04f5a4a7ae79 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:55.566571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e63edd03-4c5b-4fb8-96f0-04f5a4a7ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:55.641245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 199/409] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:55 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:55.677709 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17163c3c-5d87-45a5-ac09-dc5a8c6caa41 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:55.691216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17163c3c-5d87-45a5-ac09-dc5a8c6caa41 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:55.697128 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb5d83-1d98-4913-aa82-ca1def5b03a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:55.697963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb5d83-1d98-4913-aa82-ca1def5b03a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.698248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb5d83-1d98-4913-aa82-ca1def5b03a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.698521 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb5d83-1d98-4913-aa82-ca1def5b03a8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.714314 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb5d83-1d98-4913-aa82-ca1def5b03a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:55.721398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-c3cb5d83-1d98-4913-aa82-ca1def5b03a8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:55.722943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 211/410] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:55.731934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63edd03-4c5b-4fb8-96f0-04f5a4a7ae79 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:55.741400 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63edd03-4c5b-4fb8-96f0-04f5a4a7ae79 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:55.747431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96838840-00c9-4710-b135-387256dd2905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:55.748099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96838840-00c9-4710-b135-387256dd2905 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.748379 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96838840-00c9-4710-b135-387256dd2905 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.748654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96838840-00c9-4710-b135-387256dd2905 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.749427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96838840-00c9-4710-b135-387256dd2905 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:55.749737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96838840-00c9-4710-b135-387256dd2905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:55.751418 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96838840-00c9-4710-b135-387256dd2905 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:55.763385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 200/411] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:55.769050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb5d83-1d98-4913-aa82-ca1def5b03a8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:55.784558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb5d83-1d98-4913-aa82-ca1def5b03a8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:55.793061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe7c77-e73f-441c-9bd4-3586c8acf481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:55.793918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe7c77-e73f-441c-9bd4-3586c8acf481 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.794196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe7c77-e73f-441c-9bd4-3586c8acf481 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.794520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe7c77-e73f-441c-9bd4-3586c8acf481 admin admin] PATH_INFO: `/v3/groups/b563051dbc164226ab84dc9a2a66a754` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.796235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe7c77-e73f-441c-9bd4-3586c8acf481 admin admin] RBAC: Authorizing `identity:get_group(group_id=b563051dbc164226ab84dc9a2a66a754)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:55.798273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe7c77-e73f-441c-9bd4-3586c8acf481 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:55.800306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 212/412] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:55 2022] GET /identity/v3/groups/b563051dbc164226ab84dc9a2a66a754 => generated 230 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:55.806575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96838840-00c9-4710-b135-387256dd2905 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:55.818380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96838840-00c9-4710-b135-387256dd2905 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:55.826098 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459c9b1-c2ce-4296-b5f1-cc300b09eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:55.827084 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c9b1-c2ce-4296-b5f1-cc300b09eaed admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.827417 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c9b1-c2ce-4296-b5f1-cc300b09eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.827692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c9b1-c2ce-4296-b5f1-cc300b09eaed admin admin] PATH_INFO: `/v3/projects/6e0f1fba09874be8ae22b37e033b5e57` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.829232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459c9b1-c2ce-4296-b5f1-cc300b09eaed admin admin] RBAC: Authorizing `identity:get_project(project_id=6e0f1fba09874be8ae22b37e033b5e57)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:55.831249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459c9b1-c2ce-4296-b5f1-cc300b09eaed admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:55.833028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 201/413] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:55 2022] GET /identity/v3/projects/6e0f1fba09874be8ae22b37e033b5e57 => generated 345 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:55.839187 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe7c77-e73f-441c-9bd4-3586c8acf481 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:55.849763 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe7c77-e73f-441c-9bd4-3586c8acf481 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:55.857207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeb870-705d-41cd-a845-21a12d7885e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:55.858178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeb870-705d-41cd-a845-21a12d7885e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:55.858453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeb870-705d-41cd-a845-21a12d7885e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:55.858726 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeb870-705d-41cd-a845-21a12d7885e8 admin admin] PATH_INFO: `/v3/projects/6e0f1fba09874be8ae22b37e033b5e57/groups/b563051dbc164226ab84dc9a2a66a754/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:55.860966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeb870-705d-41cd-a845-21a12d7885e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0f1fba09874be8ae22b37e033b5e57, group_id=b563051dbc164226ab84dc9a2a66a754, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:55.863934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeb870-705d-41cd-a845-21a12d7885e8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:55.889705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 213/414] 10.222.0.117 () {58 vars in 1468 bytes} [Mon Jan 24 16:37:55 2022] PUT /identity/v3/projects/6e0f1fba09874be8ae22b37e033b5e57/groups/b563051dbc164226ab84dc9a2a66a754/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:37:56.273124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b057c-1555-472c-91f7-119d10cfd776 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.273124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b057c-1555-472c-91f7-119d10cfd776 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.273124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b057c-1555-472c-91f7-119d10cfd776 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.273124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 202/415] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:56.286327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74184a5-ed8a-4c43-acd3-be92f07ffa58 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.286327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74184a5-ed8a-4c43-acd3-be92f07ffa58 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.286327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74184a5-ed8a-4c43-acd3-be92f07ffa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.303828 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b74184a5-ed8a-4c43-acd3-be92f07ffa58 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:56.305351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b74184a5-ed8a-4c43-acd3-be92f07ffa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:56.370065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 214/416] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:56 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:56.395129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b057c-1555-472c-91f7-119d10cfd776 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.408805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b057c-1555-472c-91f7-119d10cfd776 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.413430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473b99f-798b-4ac6-b3df-8031abbe027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.415229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473b99f-798b-4ac6-b3df-8031abbe027f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.415742 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473b99f-798b-4ac6-b3df-8031abbe027f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.416290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473b99f-798b-4ac6-b3df-8031abbe027f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.428295 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473b99f-798b-4ac6-b3df-8031abbe027f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:56.436023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-b473b99f-798b-4ac6-b3df-8031abbe027f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:56.437750 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 203/417] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:56.444152 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74184a5-ed8a-4c43-acd3-be92f07ffa58 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.454823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74184a5-ed8a-4c43-acd3-be92f07ffa58 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.459654 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f8c1-08f4-4685-80ab-cc5b490aaf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.460567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f8c1-08f4-4685-80ab-cc5b490aaf01 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.461113 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f8c1-08f4-4685-80ab-cc5b490aaf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.461631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f8c1-08f4-4685-80ab-cc5b490aaf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.462598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f8c1-08f4-4685-80ab-cc5b490aaf01 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:56.463133 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f8c1-08f4-4685-80ab-cc5b490aaf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:56.464956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f8c1-08f4-4685-80ab-cc5b490aaf01 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:56.475505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 215/418] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:56.482269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473b99f-798b-4ac6-b3df-8031abbe027f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.494225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473b99f-798b-4ac6-b3df-8031abbe027f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.500107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2af58-b2f3-4ea1-8d9a-be6304751094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.501082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2af58-b2f3-4ea1-8d9a-be6304751094 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.501628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2af58-b2f3-4ea1-8d9a-be6304751094 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.502103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2af58-b2f3-4ea1-8d9a-be6304751094 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.511641 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2af58-b2f3-4ea1-8d9a-be6304751094 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:56.513725 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2af58-b2f3-4ea1-8d9a-be6304751094 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:56.523780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 204/419] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:37:56.529809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f8c1-08f4-4685-80ab-cc5b490aaf01 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.540664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f8c1-08f4-4685-80ab-cc5b490aaf01 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.545790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f5b9e-c7e0-40e0-9795-54302b76e4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.546925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f5b9e-c7e0-40e0-9795-54302b76e4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.547410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f5b9e-c7e0-40e0-9795-54302b76e4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.547902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f5b9e-c7e0-40e0-9795-54302b76e4a5 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.549414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f5b9e-c7e0-40e0-9795-54302b76e4a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:56.551782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f5b9e-c7e0-40e0-9795-54302b76e4a5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:56.554028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 216/420] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:56.560197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2af58-b2f3-4ea1-8d9a-be6304751094 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.571675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2af58-b2f3-4ea1-8d9a-be6304751094 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.576614 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b6bc8-469d-46d4-8663-cd634c1068c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.577746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b6bc8-469d-46d4-8663-cd634c1068c2 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.578228 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b6bc8-469d-46d4-8663-cd634c1068c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.578700 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b6bc8-469d-46d4-8663-cd634c1068c2 admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.580248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b6bc8-469d-46d4-8663-cd634c1068c2 admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:56.582355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b6bc8-469d-46d4-8663-cd634c1068c2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:56.584269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 205/421] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:56.591054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f5b9e-c7e0-40e0-9795-54302b76e4a5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.601558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f5b9e-c7e0-40e0-9795-54302b76e4a5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.607446 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc3088-1794-4684-ab9a-bd64202f519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.608409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc3088-1794-4684-ab9a-bd64202f519a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.608950 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc3088-1794-4684-ab9a-bd64202f519a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.609481 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc3088-1794-4684-ab9a-bd64202f519a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.610617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc3088-1794-4684-ab9a-bd64202f519a admin admin] RBAC: Adding query filter params (group.id=88669d1a3690401ebfc46baa9d6fc72e, role.id=42656495a54b4164862c9a31838a731e, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:56.611194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc3088-1794-4684-ab9a-bd64202f519a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:56.613456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc3088-1794-4684-ab9a-bd64202f519a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:56.622003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 217/422] 10.222.0.117 () {56 vars in 1402 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/role_assignments?group.id=88669d1a3690401ebfc46baa9d6fc72e&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=42656495a54b4164862c9a31838a731e => generated 613 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:56.666897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f28ee9-c2b7-4c5b-8c75-0d5af306e7e9 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.667194 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f28ee9-c2b7-4c5b-8c75-0d5af306e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.667370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f28ee9-c2b7-4c5b-8c75-0d5af306e7e9 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.669145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 206/423] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:56.675370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee70c-eb5e-419c-a231-f0044df8f5c0 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.675668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee70c-eb5e-419c-a231-f0044df8f5c0 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.675936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee70c-eb5e-419c-a231-f0044df8f5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.697513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-487ee70c-eb5e-419c-a231-f0044df8f5c0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:56.699189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-487ee70c-eb5e-419c-a231-f0044df8f5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:56.707859 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 218/424] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:56 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:56.734476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f28ee9-c2b7-4c5b-8c75-0d5af306e7e9 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.748154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f28ee9-c2b7-4c5b-8c75-0d5af306e7e9 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.753134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2a33-7b91-4bc7-a66f-e3d82c60e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.754301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2a33-7b91-4bc7-a66f-e3d82c60e285 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.754807 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2a33-7b91-4bc7-a66f-e3d82c60e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.755333 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2a33-7b91-4bc7-a66f-e3d82c60e285 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.768494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d2a33-7b91-4bc7-a66f-e3d82c60e285 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:56.777554 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-b90d2a33-7b91-4bc7-a66f-e3d82c60e285 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:56.779538 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 207/425] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:56.785544 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ee70c-eb5e-419c-a231-f0044df8f5c0 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.800251 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ee70c-eb5e-419c-a231-f0044df8f5c0 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.811235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f708d-1961-4afb-8080-f28bd46c2a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.811925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f708d-1961-4afb-8080-f28bd46c2a43 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.812208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f708d-1961-4afb-8080-f28bd46c2a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.812483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f708d-1961-4afb-8080-f28bd46c2a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.813258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f708d-1961-4afb-8080-f28bd46c2a43 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:56.813563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f708d-1961-4afb-8080-f28bd46c2a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:56.819669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f708d-1961-4afb-8080-f28bd46c2a43 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:56.830031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 219/426] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:56.835547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2a33-7b91-4bc7-a66f-e3d82c60e285 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.847397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2a33-7b91-4bc7-a66f-e3d82c60e285 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.852857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e8e0-7539-4182-a8eb-284d83c3e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.853830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e8e0-7539-4182-a8eb-284d83c3e4ad admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.854115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e8e0-7539-4182-a8eb-284d83c3e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.854390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e8e0-7539-4182-a8eb-284d83c3e4ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.865332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e8e0-7539-4182-a8eb-284d83c3e4ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:56.867262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e8e0-7539-4182-a8eb-284d83c3e4ad admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:56.878124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 208/427] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:37:56.883842 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f708d-1961-4afb-8080-f28bd46c2a43 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.894097 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f708d-1961-4afb-8080-f28bd46c2a43 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.899372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f3aaa-9f87-4164-95a4-12a4484aa5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.900493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3aaa-9f87-4164-95a4-12a4484aa5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.900780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3aaa-9f87-4164-95a4-12a4484aa5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.901054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3aaa-9f87-4164-95a4-12a4484aa5d3 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.902366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f3aaa-9f87-4164-95a4-12a4484aa5d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:56.904540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f3aaa-9f87-4164-95a4-12a4484aa5d3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:56.906621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 220/428] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:56.911831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e8e0-7539-4182-a8eb-284d83c3e4ad admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.921898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e8e0-7539-4182-a8eb-284d83c3e4ad admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.926638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b813e-800d-436f-9c46-992b9beab70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.927533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b813e-800d-436f-9c46-992b9beab70d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.927809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b813e-800d-436f-9c46-992b9beab70d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.928130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b813e-800d-436f-9c46-992b9beab70d admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.929489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b813e-800d-436f-9c46-992b9beab70d admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:56.932249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b813e-800d-436f-9c46-992b9beab70d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:56.934362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 209/429] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:56.936918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc695ab6-5c97-4c50-a5fb-9393bbcb74c4 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.937253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc695ab6-5c97-4c50-a5fb-9393bbcb74c4 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.937641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc695ab6-5c97-4c50-a5fb-9393bbcb74c4 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.939551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 221/430] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:37:56.940401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b813e-800d-436f-9c46-992b9beab70d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:56.946893 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62157128-4361-4930-8ddf-d6e0b3c985ba None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.947176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62157128-4361-4930-8ddf-d6e0b3c985ba None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.947453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62157128-4361-4930-8ddf-d6e0b3c985ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.955948 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b813e-800d-436f-9c46-992b9beab70d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:56.962119 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37e820-1cb2-4476-9700-85cbb7afed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:56.963999 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37e820-1cb2-4476-9700-85cbb7afed1d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:56.963999 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37e820-1cb2-4476-9700-85cbb7afed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:56.963999 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37e820-1cb2-4476-9700-85cbb7afed1d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:56.964331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37e820-1cb2-4476-9700-85cbb7afed1d admin admin] RBAC: Adding query filter params (group.id=88669d1a3690401ebfc46baa9d6fc72e, role.id=2d582daf740f43a8bd4b4471a3c1a99a, scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:56.964613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37e820-1cb2-4476-9700-85cbb7afed1d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:56.966449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37e820-1cb2-4476-9700-85cbb7afed1d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:56.975989 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 210/431] 10.222.0.117 () {56 vars in 1402 bytes} [Mon Jan 24 16:37:56 2022] GET /identity/v3/role_assignments?group.id=88669d1a3690401ebfc46baa9d6fc72e&scope.project.id=3035a30a67154f908dd0a8d0bd3d5b2b&role.id=2d582daf740f43a8bd4b4471a3c1a99a => generated 613 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:56.985373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-62157128-4361-4930-8ddf-d6e0b3c985ba None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:56.987096 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-62157128-4361-4930-8ddf-d6e0b3c985ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:57.004675 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 222/432] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:56 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:57.039984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37e820-1cb2-4476-9700-85cbb7afed1d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:57.052384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37e820-1cb2-4476-9700-85cbb7afed1d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:57.060744 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aec88-ef5f-4858-8b62-a863adac4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:57.061547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aec88-ef5f-4858-8b62-a863adac4263 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:57.061824 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aec88-ef5f-4858-8b62-a863adac4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:57.062095 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aec88-ef5f-4858-8b62-a863adac4263 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:57.076803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4aec88-ef5f-4858-8b62-a863adac4263 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:57.083850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-0e4aec88-ef5f-4858-8b62-a863adac4263 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 24 16:37:57.085088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 211/433] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:57.091244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62157128-4361-4930-8ddf-d6e0b3c985ba None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:57.105827 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62157128-4361-4930-8ddf-d6e0b3c985ba None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:57.112501 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe718a85-7004-4ef9-835e-869ccc5ac3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:57.113192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe718a85-7004-4ef9-835e-869ccc5ac3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:57.113531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe718a85-7004-4ef9-835e-869ccc5ac3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:57.113807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe718a85-7004-4ef9-835e-869ccc5ac3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:57.114781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe718a85-7004-4ef9-835e-869ccc5ac3e4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:57.115155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe718a85-7004-4ef9-835e-869ccc5ac3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:57.117200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe718a85-7004-4ef9-835e-869ccc5ac3e4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:57.129587 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 223/434] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:37:57 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:57.140123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aec88-ef5f-4858-8b62-a863adac4263 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:57.161846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aec88-ef5f-4858-8b62-a863adac4263 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:57.167214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f5ec1-d0cc-4ac4-8fa3-d0b76917b567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:57.167848 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f5ec1-d0cc-4ac4-8fa3-d0b76917b567 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:57.168128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f5ec1-d0cc-4ac4-8fa3-d0b76917b567 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:57.168401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f5ec1-d0cc-4ac4-8fa3-d0b76917b567 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:57.182870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f5ec1-d0cc-4ac4-8fa3-d0b76917b567 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:57.184594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f5ec1-d0cc-4ac4-8fa3-d0b76917b567 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:57.197825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 212/435] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:57 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:57.203508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe718a85-7004-4ef9-835e-869ccc5ac3e4 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:57.216656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe718a85-7004-4ef9-835e-869ccc5ac3e4 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:57.221820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feafd7-f756-4842-bd25-a4e733ef565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:57.222670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feafd7-f756-4842-bd25-a4e733ef565b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:57.223032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feafd7-f756-4842-bd25-a4e733ef565b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:57.223305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feafd7-f756-4842-bd25-a4e733ef565b admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:57.224769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feafd7-f756-4842-bd25-a4e733ef565b admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:57.229783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feafd7-f756-4842-bd25-a4e733ef565b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:57.231640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 224/436] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:57 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:57.237299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f5ec1-d0cc-4ac4-8fa3-d0b76917b567 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:57.248040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f5ec1-d0cc-4ac4-8fa3-d0b76917b567 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:57.254001 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087a7c6-1a71-4adc-bf1b-4650da11aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:57.254884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a7c6-1a71-4adc-bf1b-4650da11aa03 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:57.255165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a7c6-1a71-4adc-bf1b-4650da11aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:57.255436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a7c6-1a71-4adc-bf1b-4650da11aa03 admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:57.257869 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087a7c6-1a71-4adc-bf1b-4650da11aa03 admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:57.259794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087a7c6-1a71-4adc-bf1b-4650da11aa03 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:57.261541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 213/437] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:57 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:57.267674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feafd7-f756-4842-bd25-a4e733ef565b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:57.278500 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feafd7-f756-4842-bd25-a4e733ef565b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:57.286359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5714c1-c861-4ca9-a5f0-7328e7fa733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:57.288795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5714c1-c861-4ca9-a5f0-7328e7fa733d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:57.290226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5714c1-c861-4ca9-a5f0-7328e7fa733d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:57.291065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5714c1-c861-4ca9-a5f0-7328e7fa733d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:57.293155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5714c1-c861-4ca9-a5f0-7328e7fa733d admin admin] RBAC: Adding query filter params (group.id=88669d1a3690401ebfc46baa9d6fc72e, role.id=42656495a54b4164862c9a31838a731e, scope.project.id=3a4097a2cc55405b80afdb315dd566fe) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:57.294100 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5714c1-c861-4ca9-a5f0-7328e7fa733d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:57.297965 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5714c1-c861-4ca9-a5f0-7328e7fa733d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:57.311235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 225/438] 10.222.0.117 () {56 vars in 1402 bytes} [Mon Jan 24 16:37:57 2022] GET /identity/v3/role_assignments?group.id=88669d1a3690401ebfc46baa9d6fc72e&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=42656495a54b4164862c9a31838a731e => generated 613 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:58.422575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94135-4b3d-463e-908f-f41ca4d08028 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.423097 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94135-4b3d-463e-908f-f41ca4d08028 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.423097 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94135-4b3d-463e-908f-f41ca4d08028 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.424800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 214/439] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:58.430083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcc9b-d4d1-4284-a0c4-36d798cf960a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.430474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcc9b-d4d1-4284-a0c4-36d798cf960a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.430728 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcc9b-d4d1-4284-a0c4-36d798cf960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.448492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-2ccbcc9b-d4d1-4284-a0c4-36d798cf960a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:58.449680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2ccbcc9b-d4d1-4284-a0c4-36d798cf960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:58.457183 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 226/440] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:58 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:37:58.481727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a94135-4b3d-463e-908f-f41ca4d08028 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:58.493486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a94135-4b3d-463e-908f-f41ca4d08028 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:58.497639 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aebcc9-cf68-49a2-abc7-f3b0378ea321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:58.498408 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aebcc9-cf68-49a2-abc7-f3b0378ea321 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.498685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aebcc9-cf68-49a2-abc7-f3b0378ea321 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.498991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aebcc9-cf68-49a2-abc7-f3b0378ea321 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.508991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aebcc9-cf68-49a2-abc7-f3b0378ea321 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:58.516072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-21aebcc9-cf68-49a2-abc7-f3b0378ea321 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:37:58.517213 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 215/441] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:37:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:58.522774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcc9b-d4d1-4284-a0c4-36d798cf960a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:58.532623 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcc9b-d4d1-4284-a0c4-36d798cf960a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:58.537144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b0771-1e22-4675-b5a6-b6cabe0fba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:58.537820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b0771-1e22-4675-b5a6-b6cabe0fba45 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.538099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b0771-1e22-4675-b5a6-b6cabe0fba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.538370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b0771-1e22-4675-b5a6-b6cabe0fba45 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.540422 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b0771-1e22-4675-b5a6-b6cabe0fba45 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:58.540743 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b0771-1e22-4675-b5a6-b6cabe0fba45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:58.542400 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b0771-1e22-4675-b5a6-b6cabe0fba45 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:58.556240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 227/442] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:37:58 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:58.557557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aebcc9-cf68-49a2-abc7-f3b0378ea321 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:58.567704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aebcc9-cf68-49a2-abc7-f3b0378ea321 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:58.573312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544e18b-79dd-4a46-897f-0e640a899840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:58.573944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544e18b-79dd-4a46-897f-0e640a899840 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.574226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544e18b-79dd-4a46-897f-0e640a899840 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.574500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544e18b-79dd-4a46-897f-0e640a899840 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.583031 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544e18b-79dd-4a46-897f-0e640a899840 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:58.584806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544e18b-79dd-4a46-897f-0e640a899840 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:58.594460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 216/443] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:58 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:58.599994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b0771-1e22-4675-b5a6-b6cabe0fba45 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:58.610263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b0771-1e22-4675-b5a6-b6cabe0fba45 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:58.614501 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3b6e3-1d2e-49b3-8c71-a76656b368bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:58.615365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3b6e3-1d2e-49b3-8c71-a76656b368bc admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.615647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3b6e3-1d2e-49b3-8c71-a76656b368bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.615919 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3b6e3-1d2e-49b3-8c71-a76656b368bc admin admin] PATH_INFO: `/v3/projects/3a4097a2cc55405b80afdb315dd566fe` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.617132 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3b6e3-1d2e-49b3-8c71-a76656b368bc admin admin] RBAC: Authorizing `identity:get_project(project_id=3a4097a2cc55405b80afdb315dd566fe)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:58.619670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3b6e3-1d2e-49b3-8c71-a76656b368bc admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:58.621286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 228/444] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:58 2022] GET /identity/v3/projects/3a4097a2cc55405b80afdb315dd566fe => generated 303 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:58.626358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544e18b-79dd-4a46-897f-0e640a899840 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:58.635691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544e18b-79dd-4a46-897f-0e640a899840 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:58.639952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f19e98-23cb-42f6-ad69-b65d7812f8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:58.640768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19e98-23cb-42f6-ad69-b65d7812f8ef admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.641045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19e98-23cb-42f6-ad69-b65d7812f8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.641315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19e98-23cb-42f6-ad69-b65d7812f8ef admin admin] PATH_INFO: `/v3/groups/88669d1a3690401ebfc46baa9d6fc72e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.642487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f19e98-23cb-42f6-ad69-b65d7812f8ef admin admin] RBAC: Authorizing `identity:get_group(group_id=88669d1a3690401ebfc46baa9d6fc72e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:58.644397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f19e98-23cb-42f6-ad69-b65d7812f8ef admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:58.645924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 217/445] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:58 2022] GET /identity/v3/groups/88669d1a3690401ebfc46baa9d6fc72e => generated 227 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:37:58.656060 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3b6e3-1d2e-49b3-8c71-a76656b368bc admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:58.666241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3b6e3-1d2e-49b3-8c71-a76656b368bc admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:58.670459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388899b5-c640-458b-88f6-1cc9207bde90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:58.671113 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388899b5-c640-458b-88f6-1cc9207bde90 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.671392 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388899b5-c640-458b-88f6-1cc9207bde90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.671663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388899b5-c640-458b-88f6-1cc9207bde90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.672495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388899b5-c640-458b-88f6-1cc9207bde90 admin admin] RBAC: Adding query filter params (group.id=88669d1a3690401ebfc46baa9d6fc72e, role.id=2d582daf740f43a8bd4b4471a3c1a99a, scope.project.id=3a4097a2cc55405b80afdb315dd566fe) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:58.672848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388899b5-c640-458b-88f6-1cc9207bde90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:58.674626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388899b5-c640-458b-88f6-1cc9207bde90 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:58.681204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 229/446] 10.222.0.117 () {56 vars in 1402 bytes} [Mon Jan 24 16:37:58 2022] GET /identity/v3/role_assignments?group.id=88669d1a3690401ebfc46baa9d6fc72e&scope.project.id=3a4097a2cc55405b80afdb315dd566fe&role.id=2d582daf740f43a8bd4b4471a3c1a99a => generated 613 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:58.795282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb28605-7a46-4ece-a831-e5e19e47c82c None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.795565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb28605-7a46-4ece-a831-e5e19e47c82c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.795842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb28605-7a46-4ece-a831-e5e19e47c82c None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.797609 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 218/447] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:37:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:37:58.803412 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc518f5e-0e5f-4ce2-a252-382b6b5bec8e None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.803781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc518f5e-0e5f-4ce2-a252-382b6b5bec8e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.804065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc518f5e-0e5f-4ce2-a252-382b6b5bec8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.823776 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-dc518f5e-0e5f-4ce2-a252-382b6b5bec8e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:37:58.825048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-dc518f5e-0e5f-4ce2-a252-382b6b5bec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:37:58.832863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 230/448] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:37:58 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:37:58.857887 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb28605-7a46-4ece-a831-e5e19e47c82c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:58.870618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb28605-7a46-4ece-a831-e5e19e47c82c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:58.874875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa439625-6f3a-488b-9d7a-77128483a996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:58.875640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa439625-6f3a-488b-9d7a-77128483a996 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.875917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa439625-6f3a-488b-9d7a-77128483a996 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.876189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa439625-6f3a-488b-9d7a-77128483a996 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.886478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa439625-6f3a-488b-9d7a-77128483a996 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:37:58.893149 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-fa439625-6f3a-488b-9d7a-77128483a996 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:37:58.894304 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 219/449] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:37:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:37:58.900449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc518f5e-0e5f-4ce2-a252-382b6b5bec8e None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:58.909424 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc518f5e-0e5f-4ce2-a252-382b6b5bec8e None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:58.914888 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f9b09-f371-4bb5-a227-e377da53637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:58.915653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f9b09-f371-4bb5-a227-e377da53637b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.915935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f9b09-f371-4bb5-a227-e377da53637b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.916220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f9b09-f371-4bb5-a227-e377da53637b admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.916979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f9b09-f371-4bb5-a227-e377da53637b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:58.917293 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f9b09-f371-4bb5-a227-e377da53637b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:58.919006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f9b09-f371-4bb5-a227-e377da53637b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:58.927601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 231/450] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:37:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:58.934277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa439625-6f3a-488b-9d7a-77128483a996 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:58.944018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa439625-6f3a-488b-9d7a-77128483a996 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:58.948685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8e65d-e4f8-459c-b265-b99783011003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:58.949320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8e65d-e4f8-459c-b265-b99783011003 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.949605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8e65d-e4f8-459c-b265-b99783011003 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.949883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8e65d-e4f8-459c-b265-b99783011003 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.958480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8e65d-e4f8-459c-b265-b99783011003 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:58.960267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8e65d-e4f8-459c-b265-b99783011003 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:58.969900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 220/451] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:37:58 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:37:58.975529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f9b09-f371-4bb5-a227-e377da53637b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:58.986375 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f9b09-f371-4bb5-a227-e377da53637b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:58.990887 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c66f2-e4a4-4932-92a3-60071e617832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:58.991733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c66f2-e4a4-4932-92a3-60071e617832 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:58.992065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c66f2-e4a4-4932-92a3-60071e617832 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:58.992323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c66f2-e4a4-4932-92a3-60071e617832 admin admin] PATH_INFO: `/v3/projects/6e0f1fba09874be8ae22b37e033b5e57` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:58.993541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c66f2-e4a4-4932-92a3-60071e617832 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e0f1fba09874be8ae22b37e033b5e57)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:58.995371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c66f2-e4a4-4932-92a3-60071e617832 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:58.997079 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 232/452] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:37:58 2022] GET /identity/v3/projects/6e0f1fba09874be8ae22b37e033b5e57 => generated 345 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:59.002443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8e65d-e4f8-459c-b265-b99783011003 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:59.011775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8e65d-e4f8-459c-b265-b99783011003 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:59.016282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f0430-3907-4e01-80da-52f2e09de758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:59.017116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f0430-3907-4e01-80da-52f2e09de758 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:59.017394 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f0430-3907-4e01-80da-52f2e09de758 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:59.017668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f0430-3907-4e01-80da-52f2e09de758 admin admin] PATH_INFO: `/v3/groups/b563051dbc164226ab84dc9a2a66a754` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:59.018880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f0430-3907-4e01-80da-52f2e09de758 admin admin] RBAC: Authorizing `identity:get_group(group_id=b563051dbc164226ab84dc9a2a66a754)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:59.020760 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f0430-3907-4e01-80da-52f2e09de758 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:59.022312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 221/453] 10.222.0.117 () {56 vars in 1206 bytes} [Mon Jan 24 16:37:59 2022] GET /identity/v3/groups/b563051dbc164226ab84dc9a2a66a754 => generated 230 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:37:59.031044 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c66f2-e4a4-4932-92a3-60071e617832 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:37:59.041594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c66f2-e4a4-4932-92a3-60071e617832 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:37:59.046045 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02d6e6-c50e-477c-98a0-4f44e294edf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:37:59.046683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d6e6-c50e-477c-98a0-4f44e294edf9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:37:59.047002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d6e6-c50e-477c-98a0-4f44e294edf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:37:59.047279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d6e6-c50e-477c-98a0-4f44e294edf9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:37:59.048126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d6e6-c50e-477c-98a0-4f44e294edf9 admin admin] RBAC: Adding query filter params (group.id=b563051dbc164226ab84dc9a2a66a754, role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=6e0f1fba09874be8ae22b37e033b5e57) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:37:59.048437 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d6e6-c50e-477c-98a0-4f44e294edf9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:37:59.050345 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d6e6-c50e-477c-98a0-4f44e294edf9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:37:59.057168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 233/454] 10.222.0.117 () {56 vars in 1402 bytes} [Mon Jan 24 16:37:59 2022] GET /identity/v3/role_assignments?group.id=b563051dbc164226ab84dc9a2a66a754&scope.project.id=6e0f1fba09874be8ae22b37e033b5e57&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 613 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:01.666788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd8f6-699b-4a17-9d59-031af898713f None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:01.667359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd8f6-699b-4a17-9d59-031af898713f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:01.667359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd8f6-699b-4a17-9d59-031af898713f None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:01.669541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 222/455] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:01.675375 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aeec0-e666-435d-b60b-e76f39d533cb None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:01.675849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aeec0-e666-435d-b60b-e76f39d533cb None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:01.675950 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aeec0-e666-435d-b60b-e76f39d533cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:01.711061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-919aeec0-e666-435d-b60b-e76f39d533cb None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:01.712267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-919aeec0-e666-435d-b60b-e76f39d533cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:01.725292 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 234/456] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:01 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:38:01.761937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd8f6-699b-4a17-9d59-031af898713f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:01.781269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd8f6-699b-4a17-9d59-031af898713f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:01.791368 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e24e-6b66-45b8-bb09-c512ac0e46e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:01.792156 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e24e-6b66-45b8-bb09-c512ac0e46e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:01.792437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e24e-6b66-45b8-bb09-c512ac0e46e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:01.792713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e24e-6b66-45b8-bb09-c512ac0e46e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:01.803580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9e24e-6b66-45b8-bb09-c512ac0e46e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:01.806158 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9e24e-6b66-45b8-bb09-c512ac0e46e7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:01.828425 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-09d9e24e-6b66-45b8-bb09-c512ac0e46e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:01.829962 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 223/457] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:01.835319 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919aeec0-e666-435d-b60b-e76f39d533cb None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:01.847669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919aeec0-e666-435d-b60b-e76f39d533cb None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:01.855940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0e81-f933-4277-ad42-ccafdef56e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:01.856612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0e81-f933-4277-ad42-ccafdef56e17 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:01.856897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0e81-f933-4277-ad42-ccafdef56e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:01.857175 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0e81-f933-4277-ad42-ccafdef56e17 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:01.857925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b0e81-f933-4277-ad42-ccafdef56e17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:01.858232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b0e81-f933-4277-ad42-ccafdef56e17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:01.859295 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-c87b0e81-f933-4277-ad42-ccafdef56e17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:01.859295 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:38:01.859295 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:38:01.860179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b0e81-f933-4277-ad42-ccafdef56e17 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:01.881681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 235/458] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:01.887496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e24e-6b66-45b8-bb09-c512ac0e46e7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:01.899928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e24e-6b66-45b8-bb09-c512ac0e46e7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:01.907369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade19af3-f20a-48fc-90ed-1d695825d635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:01.908030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade19af3-f20a-48fc-90ed-1d695825d635 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:01.908316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade19af3-f20a-48fc-90ed-1d695825d635 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:01.908595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade19af3-f20a-48fc-90ed-1d695825d635 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:01.909335 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade19af3-f20a-48fc-90ed-1d695825d635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:01.911296 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade19af3-f20a-48fc-90ed-1d695825d635 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:01.944362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 224/459] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:38:01 2022] POST /identity/v3/users => generated 247 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:01.984011 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c405f7-fc9b-4304-88f7-cef3f59ab278 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:01.984354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c405f7-fc9b-4304-88f7-cef3f59ab278 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:01.984624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c405f7-fc9b-4304-88f7-cef3f59ab278 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:01.986886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 236/460] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:01.992673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fe5a6-d71a-49ac-b54b-2171bd855ea1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:01.992986 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fe5a6-d71a-49ac-b54b-2171bd855ea1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:01.993210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fe5a6-d71a-49ac-b54b-2171bd855ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.023838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ef0fe5a6-d71a-49ac-b54b-2171bd855ea1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:02.025233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ef0fe5a6-d71a-49ac-b54b-2171bd855ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:02.032019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa8a6d-c38a-450d-a16e-ce26d541326c None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.032324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa8a6d-c38a-450d-a16e-ce26d541326c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.032572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa8a6d-c38a-450d-a16e-ce26d541326c None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.034706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 237/461] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:02.038424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 225/462] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:01 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:38:02.041057 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a20485-1c0c-498f-98f1-ef4ad36b38f8 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.041343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a20485-1c0c-498f-98f1-ef4ad36b38f8 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.041619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a20485-1c0c-498f-98f1-ef4ad36b38f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.066785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fe5a6-d71a-49ac-b54b-2171bd855ea1 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:02.072370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-63a20485-1c0c-498f-98f1-ef4ad36b38f8 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:02.074212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-63a20485-1c0c-498f-98f1-ef4ad36b38f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:02.081903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fe5a6-d71a-49ac-b54b-2171bd855ea1 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:02.098907 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 238/463] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:02 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:38:02.099791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c12f0-5fa1-4621-8c8a-619bef04b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:02.100623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c12f0-5fa1-4621-8c8a-619bef04b810 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.100907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c12f0-5fa1-4621-8c8a-619bef04b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.101228 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c12f0-5fa1-4621-8c8a-619bef04b810 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.114938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c12f0-5fa1-4621-8c8a-619bef04b810 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:02.117383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c12f0-5fa1-4621-8c8a-619bef04b810 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:02.134134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a20485-1c0c-498f-98f1-ef4ad36b38f8 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:02.143420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-a81c12f0-5fa1-4621-8c8a-619bef04b810 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:02.143703 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a20485-1c0c-498f-98f1-ef4ad36b38f8 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:02.149775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 226/464] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:02.151126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c12f0-5fa1-4621-8c8a-619bef04b810 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:02.158727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafab216-f3a9-4c6b-b40f-6efc35de454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:02.159567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafab216-f3a9-4c6b-b40f-6efc35de454a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.159849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafab216-f3a9-4c6b-b40f-6efc35de454a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.160122 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafab216-f3a9-4c6b-b40f-6efc35de454a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.167636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c12f0-5fa1-4621-8c8a-619bef04b810 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:02.180238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca174-f69c-4ebe-99cb-ca8937488443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:02.180656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca174-f69c-4ebe-99cb-ca8937488443 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.180881 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca174-f69c-4ebe-99cb-ca8937488443 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.181157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca174-f69c-4ebe-99cb-ca8937488443 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.181911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca174-f69c-4ebe-99cb-ca8937488443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:02.182215 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca174-f69c-4ebe-99cb-ca8937488443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:02.183860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca174-f69c-4ebe-99cb-ca8937488443 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:02.186858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafab216-f3a9-4c6b-b40f-6efc35de454a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:02.188783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafab216-f3a9-4c6b-b40f-6efc35de454a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:02.202875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 227/465] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:02.209134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca174-f69c-4ebe-99cb-ca8937488443 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:02.219029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-cafab216-f3a9-4c6b-b40f-6efc35de454a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:02.221115 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 239/466] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:02.226983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca174-f69c-4ebe-99cb-ca8937488443 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:02.230280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafab216-f3a9-4c6b-b40f-6efc35de454a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:02.232138 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a87742-b975-4f3b-94f0-22ed572f7c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:02.233093 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a87742-b975-4f3b-94f0-22ed572f7c0a admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.233627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a87742-b975-4f3b-94f0-22ed572f7c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.234132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a87742-b975-4f3b-94f0-22ed572f7c0a admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.235096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a87742-b975-4f3b-94f0-22ed572f7c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:02.237510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a87742-b975-4f3b-94f0-22ed572f7c0a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:02.242881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafab216-f3a9-4c6b-b40f-6efc35de454a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:02.251975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20956-ee19-494b-9064-20b38c83cddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:02.253008 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20956-ee19-494b-9064-20b38c83cddd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.253545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20956-ee19-494b-9064-20b38c83cddd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.253886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20956-ee19-494b-9064-20b38c83cddd admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.254672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af20956-ee19-494b-9064-20b38c83cddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:02.255044 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af20956-ee19-494b-9064-20b38c83cddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:02.258190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af20956-ee19-494b-9064-20b38c83cddd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:02.265690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 228/467] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:38:02 2022] POST /identity/v3/users => generated 249 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:38:02.280588 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 240/468] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:02.282310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a87742-b975-4f3b-94f0-22ed572f7c0a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:02.294126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a87742-b975-4f3b-94f0-22ed572f7c0a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:02.299445 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1060bf-33f9-48a4-b53a-9a59a9de673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:02.300799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1060bf-33f9-48a4-b53a-9a59a9de673b admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.301332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1060bf-33f9-48a4-b53a-9a59a9de673b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.301823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1060bf-33f9-48a4-b53a-9a59a9de673b admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.304134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1060bf-33f9-48a4-b53a-9a59a9de673b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:02.306560 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1060bf-33f9-48a4-b53a-9a59a9de673b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:02.335229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 229/469] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:38:02 2022] POST /identity/v3/users => generated 249 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:02.587163 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26029c8-a099-4aca-ba97-e065a08510e3 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.587556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26029c8-a099-4aca-ba97-e065a08510e3 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.587732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26029c8-a099-4aca-ba97-e065a08510e3 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.589873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 241/470] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:02.595081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dad8b8-7b63-4bcb-a213-87045e234cb7 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.595688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dad8b8-7b63-4bcb-a213-87045e234cb7 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.596190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dad8b8-7b63-4bcb-a213-87045e234cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.617878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-10dad8b8-7b63-4bcb-a213-87045e234cb7 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:02.619430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-10dad8b8-7b63-4bcb-a213-87045e234cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:02.630925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 230/471] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:02 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:02.656019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26029c8-a099-4aca-ba97-e065a08510e3 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:02.673856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26029c8-a099-4aca-ba97-e065a08510e3 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:02.680190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eff88-00fc-4dca-9e1c-cbff2cf5b770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:02.681080 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eff88-00fc-4dca-9e1c-cbff2cf5b770 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.681413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eff88-00fc-4dca-9e1c-cbff2cf5b770 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.681682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eff88-00fc-4dca-9e1c-cbff2cf5b770 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.693534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eff88-00fc-4dca-9e1c-cbff2cf5b770 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:02.695621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eff88-00fc-4dca-9e1c-cbff2cf5b770 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:02.716215 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-d22eff88-00fc-4dca-9e1c-cbff2cf5b770 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:02.717762 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 242/472] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:02.723124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dad8b8-7b63-4bcb-a213-87045e234cb7 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:02.738776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dad8b8-7b63-4bcb-a213-87045e234cb7 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:02.744262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1309ae-8d8b-4c64-bc03-d0eef0442528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:02.745171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1309ae-8d8b-4c64-bc03-d0eef0442528 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.745649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1309ae-8d8b-4c64-bc03-d0eef0442528 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.746118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1309ae-8d8b-4c64-bc03-d0eef0442528 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.749800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1309ae-8d8b-4c64-bc03-d0eef0442528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:02.750351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1309ae-8d8b-4c64-bc03-d0eef0442528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:02.752190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1309ae-8d8b-4c64-bc03-d0eef0442528 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:02.773338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 231/473] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:02.778629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eff88-00fc-4dca-9e1c-cbff2cf5b770 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:02.792959 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eff88-00fc-4dca-9e1c-cbff2cf5b770 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:02.803238 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e79d-0267-4bfa-b2fb-f30bea558794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:02.803946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e79d-0267-4bfa-b2fb-f30bea558794 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:02.804851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e79d-0267-4bfa-b2fb-f30bea558794 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:02.805159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e79d-0267-4bfa-b2fb-f30bea558794 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:02.805894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389e79d-0267-4bfa-b2fb-f30bea558794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:02.807931 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389e79d-0267-4bfa-b2fb-f30bea558794 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:02.840156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 243/474] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:38:02 2022] POST /identity/v3/users => generated 250 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:03.708027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e4f38-2a28-45b4-b39a-c63eed004571 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:03.708478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e4f38-2a28-45b4-b39a-c63eed004571 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:03.708580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e4f38-2a28-45b4-b39a-c63eed004571 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:03.711390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 232/475] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:03.717207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a7f6-aabd-4b2b-8489-c41bc54340e8 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:03.718106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a7f6-aabd-4b2b-8489-c41bc54340e8 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:03.718576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a7f6-aabd-4b2b-8489-c41bc54340e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:03.741018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-1b62a7f6-aabd-4b2b-8489-c41bc54340e8 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:03.743677 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1b62a7f6-aabd-4b2b-8489-c41bc54340e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:03.759529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 244/476] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:03 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:03.800238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e4f38-2a28-45b4-b39a-c63eed004571 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:03.812746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e4f38-2a28-45b4-b39a-c63eed004571 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:03.822965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bbb24-625f-4c7a-ab98-c7bb6f7a61ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:03.823621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bbb24-625f-4c7a-ab98-c7bb6f7a61ae admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:03.823903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bbb24-625f-4c7a-ab98-c7bb6f7a61ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:03.824175 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bbb24-625f-4c7a-ab98-c7bb6f7a61ae admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:03.824938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bbb24-625f-4c7a-ab98-c7bb6f7a61ae admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:03.826529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bbb24-625f-4c7a-ab98-c7bb6f7a61ae admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:03.833595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.sql.core [None req-753bbb24-625f-4c7a-ab98-c7bb6f7a61ae admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 24 16:38:03.833595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 24 16:38:03.833595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [parameters: {'id': '75b5cc0b8a3840f39082066e90b71522', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 24 16:38:03.833595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90770) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 24 16:38:03.848427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-753bbb24-625f-4c7a-ab98-c7bb6f7a61ae admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 24 16:38:03.850002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 233/477] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:38:03 2022] POST /identity/v3/roles => generated 144 bytes in 50 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:03.855904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62a7f6-aabd-4b2b-8489-c41bc54340e8 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:03.865395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62a7f6-aabd-4b2b-8489-c41bc54340e8 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:03.878047 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb326dd4-0c68-433c-ba2d-6cd2001a2393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:03.879155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb326dd4-0c68-433c-ba2d-6cd2001a2393 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:03.879633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb326dd4-0c68-433c-ba2d-6cd2001a2393 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:03.880102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb326dd4-0c68-433c-ba2d-6cd2001a2393 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:03.895642 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb326dd4-0c68-433c-ba2d-6cd2001a2393 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:03.903762 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-bb326dd4-0c68-433c-ba2d-6cd2001a2393 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 24 16:38:03.905258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 245/478] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:38:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:03.910612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bbb24-625f-4c7a-ab98-c7bb6f7a61ae admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:03.924281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bbb24-625f-4c7a-ab98-c7bb6f7a61ae admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:03.934311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbf45f-5c17-4acb-a6ff-9d9f023d5ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:03.935032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf45f-5c17-4acb-a6ff-9d9f023d5ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:03.935318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf45f-5c17-4acb-a6ff-9d9f023d5ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:03.935593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf45f-5c17-4acb-a6ff-9d9f023d5ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:03.936351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbf45f-5c17-4acb-a6ff-9d9f023d5ca4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:03.936653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbf45f-5c17-4acb-a6ff-9d9f023d5ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:03.938242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbf45f-5c17-4acb-a6ff-9d9f023d5ca4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:03.947195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 234/479] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:03 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:04.939629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7f413-0787-49a7-b435-56ddd2f77e45 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:04.940145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7f413-0787-49a7-b435-56ddd2f77e45 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:04.940145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7f413-0787-49a7-b435-56ddd2f77e45 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:04.942199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 246/480] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:04.947459 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ce1f-1d61-4d54-ac00-cec41298a101 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:04.947862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ce1f-1d61-4d54-ac00-cec41298a101 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:04.948043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ce1f-1d61-4d54-ac00-cec41298a101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:04.972357 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-0265ce1f-1d61-4d54-ac00-cec41298a101 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:04.973596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0265ce1f-1d61-4d54-ac00-cec41298a101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:04.984915 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 235/481] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:04 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:05.010484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7f413-0787-49a7-b435-56ddd2f77e45 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.026746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7f413-0787-49a7-b435-56ddd2f77e45 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.031725 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e51d8-b25c-4cc6-adeb-7652f0681a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.032506 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e51d8-b25c-4cc6-adeb-7652f0681a42 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.032785 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e51d8-b25c-4cc6-adeb-7652f0681a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.033056 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e51d8-b25c-4cc6-adeb-7652f0681a42 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.053612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e51d8-b25c-4cc6-adeb-7652f0681a42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:05.060805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-752e51d8-b25c-4cc6-adeb-7652f0681a42 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:05.063317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 247/482] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.068058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265ce1f-1d61-4d54-ac00-cec41298a101 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.081164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265ce1f-1d61-4d54-ac00-cec41298a101 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.087259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97eda9-cb33-4806-ab58-f43b98c9d50a None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.087545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97eda9-cb33-4806-ab58-f43b98c9d50a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.087824 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97eda9-cb33-4806-ab58-f43b98c9d50a None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.090712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43832ed5-cde4-4a63-8d5b-34d44656d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.091401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43832ed5-cde4-4a63-8d5b-34d44656d2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.091683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43832ed5-cde4-4a63-8d5b-34d44656d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.091956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43832ed5-cde4-4a63-8d5b-34d44656d2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.092729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43832ed5-cde4-4a63-8d5b-34d44656d2c1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.093032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43832ed5-cde4-4a63-8d5b-34d44656d2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.094635 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43832ed5-cde4-4a63-8d5b-34d44656d2c1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.096638 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 248/483] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:05 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:05.103589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67372d43-d9c8-48a3-acdb-1254b6cf9c7a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.103818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67372d43-d9c8-48a3-acdb-1254b6cf9c7a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.103994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67372d43-d9c8-48a3-acdb-1254b6cf9c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.116364 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 236/484] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.127952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43832ed5-cde4-4a63-8d5b-34d44656d2c1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.139206 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-67372d43-d9c8-48a3-acdb-1254b6cf9c7a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:05.140410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-67372d43-d9c8-48a3-acdb-1254b6cf9c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:05.147298 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43832ed5-cde4-4a63-8d5b-34d44656d2c1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.150113 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 249/485] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:05 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:38:05.164697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96f759-bbc2-4007-9cea-704fa8611c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.165804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f759-bbc2-4007-9cea-704fa8611c11 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.166360 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f759-bbc2-4007-9cea-704fa8611c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.166864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f759-bbc2-4007-9cea-704fa8611c11 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.178211 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67372d43-d9c8-48a3-acdb-1254b6cf9c7a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.188595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67372d43-d9c8-48a3-acdb-1254b6cf9c7a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.195605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96f759-bbc2-4007-9cea-704fa8611c11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.200163 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dd02f-47e8-4d63-a961-0bfeaa44954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.202204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dd02f-47e8-4d63-a961-0bfeaa44954d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.202698 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96f759-bbc2-4007-9cea-704fa8611c11 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.203242 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dd02f-47e8-4d63-a961-0bfeaa44954d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.204153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dd02f-47e8-4d63-a961-0bfeaa44954d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.224744 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dd02f-47e8-4d63-a961-0bfeaa44954d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:05.230318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-7c96f759-bbc2-4007-9cea-704fa8611c11 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:05.234231 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-c90dd02f-47e8-4d63-a961-0bfeaa44954d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:05.234231 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 250/487] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.234425 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 237/487] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:05.239596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dd02f-47e8-4d63-a961-0bfeaa44954d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.240356 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96f759-bbc2-4007-9cea-704fa8611c11 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.254721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dd02f-47e8-4d63-a961-0bfeaa44954d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.254916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96f759-bbc2-4007-9cea-704fa8611c11 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.259751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e79125-47fd-4d25-8bd2-65da48fdb294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.259908 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827369fe-2f3e-4665-9e26-6bed3f62c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.260415 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e79125-47fd-4d25-8bd2-65da48fdb294 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.260521 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827369fe-2f3e-4665-9e26-6bed3f62c25b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.260718 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e79125-47fd-4d25-8bd2-65da48fdb294 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.260825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827369fe-2f3e-4665-9e26-6bed3f62c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.260970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e79125-47fd-4d25-8bd2-65da48fdb294 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.261057 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827369fe-2f3e-4665-9e26-6bed3f62c25b admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.261724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e79125-47fd-4d25-8bd2-65da48fdb294 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.261825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827369fe-2f3e-4665-9e26-6bed3f62c25b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.262026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e79125-47fd-4d25-8bd2-65da48fdb294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.262123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827369fe-2f3e-4665-9e26-6bed3f62c25b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.263675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e79125-47fd-4d25-8bd2-65da48fdb294 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.263786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827369fe-2f3e-4665-9e26-6bed3f62c25b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.274963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 238/488] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:05.277087 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05478-3a14-4a4b-b149-6deb959e7a68 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.277369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05478-3a14-4a4b-b149-6deb959e7a68 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.277644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05478-3a14-4a4b-b149-6deb959e7a68 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.279605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 239/490] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:05.283539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 251/490] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.284606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05478-3a14-4a4b-b149-6deb959e7a68 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.285241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de83e0-68ab-42ba-8d48-d254f7f57a81 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.285606 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de83e0-68ab-42ba-8d48-d254f7f57a81 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.285957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de83e0-68ab-42ba-8d48-d254f7f57a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.298884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05478-3a14-4a4b-b149-6deb959e7a68 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.304142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef1d7c-f8a9-4dcd-aab9-8c10593b5ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.304964 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef1d7c-f8a9-4dcd-aab9-8c10593b5ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.305388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef1d7c-f8a9-4dcd-aab9-8c10593b5ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.305669 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef1d7c-f8a9-4dcd-aab9-8c10593b5ff7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.307679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d5de83e0-68ab-42ba-8d48-d254f7f57a81 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:05.309498 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d5de83e0-68ab-42ba-8d48-d254f7f57a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:05.318443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef1d7c-f8a9-4dcd-aab9-8c10593b5ff7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.319163 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 252/491] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:05 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:05.321047 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de83e0-68ab-42ba-8d48-d254f7f57a81 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.328590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef1d7c-f8a9-4dcd-aab9-8c10593b5ff7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.332234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de83e0-68ab-42ba-8d48-d254f7f57a81 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.337734 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c1768-98ed-4406-861e-dbe9af7fbffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.338564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c1768-98ed-4406-861e-dbe9af7fbffc admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.338992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c1768-98ed-4406-861e-dbe9af7fbffc admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.339272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c1768-98ed-4406-861e-dbe9af7fbffc admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.360026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c1768-98ed-4406-861e-dbe9af7fbffc admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.360371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-daef1d7c-f8a9-4dcd-aab9-8c10593b5ff7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:05.361804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 240/492] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.362245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c1768-98ed-4406-861e-dbe9af7fbffc admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.362594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef1d7c-f8a9-4dcd-aab9-8c10593b5ff7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.373376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef1d7c-f8a9-4dcd-aab9-8c10593b5ff7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.377903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12394f-0e23-4059-b091-c811537b399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.378452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-5e1c1768-98ed-4406-861e-dbe9af7fbffc admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 24 16:38:05.378672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12394f-0e23-4059-b091-c811537b399d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.378991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12394f-0e23-4059-b091-c811537b399d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.379270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12394f-0e23-4059-b091-c811537b399d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.380065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 253/493] 10.222.0.117 () {56 vars in 1119 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.380841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c1768-98ed-4406-861e-dbe9af7fbffc admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.393894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c1768-98ed-4406-861e-dbe9af7fbffc admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.395264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12394f-0e23-4059-b091-c811537b399d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:05.398712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd674a-e3f8-4152-8a22-0f01b0045d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.399142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd674a-e3f8-4152-8a22-0f01b0045d13 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.399423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd674a-e3f8-4152-8a22-0f01b0045d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.399699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd674a-e3f8-4152-8a22-0f01b0045d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.400437 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd674a-e3f8-4152-8a22-0f01b0045d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.400743 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd674a-e3f8-4152-8a22-0f01b0045d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.402963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd674a-e3f8-4152-8a22-0f01b0045d13 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.403253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-eb12394f-0e23-4059-b091-c811537b399d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:05.406452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 241/494] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.407555 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12394f-0e23-4059-b091-c811537b399d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.422287 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 254/495] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.423096 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd674a-e3f8-4152-8a22-0f01b0045d13 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.426433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12394f-0e23-4059-b091-c811537b399d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.438537 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566f09d-e6cc-47b1-9270-355c511e0201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.438904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd674a-e3f8-4152-8a22-0f01b0045d13 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.439242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566f09d-e6cc-47b1-9270-355c511e0201 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.439527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566f09d-e6cc-47b1-9270-355c511e0201 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.439889 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566f09d-e6cc-47b1-9270-355c511e0201 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.440861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566f09d-e6cc-47b1-9270-355c511e0201 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.441262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566f09d-e6cc-47b1-9270-355c511e0201 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.442404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-b566f09d-e6cc-47b1-9270-355c511e0201 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:05.442404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:38:05.442404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:38:05.443659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104089c-9a3f-4977-b550-35335f1b24c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.443839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566f09d-e6cc-47b1-9270-355c511e0201 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.444371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104089c-9a3f-4977-b550-35335f1b24c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.445012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104089c-9a3f-4977-b550-35335f1b24c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.445596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104089c-9a3f-4977-b550-35335f1b24c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.446880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104089c-9a3f-4977-b550-35335f1b24c6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.447143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104089c-9a3f-4977-b550-35335f1b24c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.448877 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104089c-9a3f-4977-b550-35335f1b24c6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.458362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 255/496] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.459153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104089c-9a3f-4977-b550-35335f1b24c6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.474190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104089c-9a3f-4977-b550-35335f1b24c6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.480143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec44747-2b03-4333-a230-f350aeb90a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.480933 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec44747-2b03-4333-a230-f350aeb90a04 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.481348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec44747-2b03-4333-a230-f350aeb90a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.481620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec44747-2b03-4333-a230-f350aeb90a04 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.490306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec44747-2b03-4333-a230-f350aeb90a04 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.493116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec44747-2b03-4333-a230-f350aeb90a04 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.507184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 242/497] 10.222.0.117 () {56 vars in 1159 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.507361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-8ec44747-2b03-4333-a230-f350aeb90a04 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 24 16:38:05.508566 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 256/498] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.509082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566f09d-e6cc-47b1-9270-355c511e0201 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.510818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec44747-2b03-4333-a230-f350aeb90a04 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.521834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec44747-2b03-4333-a230-f350aeb90a04 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.525891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566f09d-e6cc-47b1-9270-355c511e0201 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.527640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a685e3e-dd64-4f11-b033-18db89e5d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.528651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a685e3e-dd64-4f11-b033-18db89e5d464 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.529162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a685e3e-dd64-4f11-b033-18db89e5d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.529634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a685e3e-dd64-4f11-b033-18db89e5d464 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.530727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb76be-6c7f-47eb-baac-db04c0226ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.531640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb76be-6c7f-47eb-baac-db04c0226ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.531921 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb76be-6c7f-47eb-baac-db04c0226ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.532198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb76be-6c7f-47eb-baac-db04c0226ac3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.540907 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a685e3e-dd64-4f11-b033-18db89e5d464 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.543945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a685e3e-dd64-4f11-b033-18db89e5d464 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.545332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb76be-6c7f-47eb-baac-db04c0226ac3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.547331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb76be-6c7f-47eb-baac-db04c0226ac3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.560952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 257/499] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:38:05.560952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a685e3e-dd64-4f11-b033-18db89e5d464 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.571982 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a685e3e-dd64-4f11-b033-18db89e5d464 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.573129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-33bb76be-6c7f-47eb-baac-db04c0226ac3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:05.574695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 243/500] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.579953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb76be-6c7f-47eb-baac-db04c0226ac3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.584463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d64bf-f699-485f-b37b-326ff55ba097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.586407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d64bf-f699-485f-b37b-326ff55ba097 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.586928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d64bf-f699-485f-b37b-326ff55ba097 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.587404 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d64bf-f699-485f-b37b-326ff55ba097 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.588539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d64bf-f699-485f-b37b-326ff55ba097 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.589108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d64bf-f699-485f-b37b-326ff55ba097 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.590409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-020d64bf-f699-485f-b37b-326ff55ba097 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:05.590409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:38:05.590409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:38:05.591901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d64bf-f699-485f-b37b-326ff55ba097 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.592006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb76be-6c7f-47eb-baac-db04c0226ac3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.596707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e34cc-cc97-4e8f-ad04-b34e3c53b9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.597486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e34cc-cc97-4e8f-ad04-b34e3c53b9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.597792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e34cc-cc97-4e8f-ad04-b34e3c53b9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.598053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e34cc-cc97-4e8f-ad04-b34e3c53b9c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.609557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e34cc-cc97-4e8f-ad04-b34e3c53b9c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.611451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e34cc-cc97-4e8f-ad04-b34e3c53b9c5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.631024 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-b83e34cc-cc97-4e8f-ad04-b34e3c53b9c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:05.632810 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 244/501] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.638568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 258/502] 10.222.0.117 () {56 vars in 1163 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.638775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e34cc-cc97-4e8f-ad04-b34e3c53b9c5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.644284 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d64bf-f699-485f-b37b-326ff55ba097 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.654005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e34cc-cc97-4e8f-ad04-b34e3c53b9c5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.655820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d64bf-f699-485f-b37b-326ff55ba097 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.658847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d80213-5f22-4cbd-8d80-c21614c46b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.659500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d80213-5f22-4cbd-8d80-c21614c46b68 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.659791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d80213-5f22-4cbd-8d80-c21614c46b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.660054 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d80213-5f22-4cbd-8d80-c21614c46b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.660785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d80213-5f22-4cbd-8d80-c21614c46b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.661074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d80213-5f22-4cbd-8d80-c21614c46b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.662668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d80213-5f22-4cbd-8d80-c21614c46b68 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.662800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547cc0e-7e91-4be1-b59f-9761ccf7d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.663773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547cc0e-7e91-4be1-b59f-9761ccf7d24a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.664251 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547cc0e-7e91-4be1-b59f-9761ccf7d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.664716 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547cc0e-7e91-4be1-b59f-9761ccf7d24a admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.665825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547cc0e-7e91-4be1-b59f-9761ccf7d24a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.666378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547cc0e-7e91-4be1-b59f-9761ccf7d24a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.668283 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547cc0e-7e91-4be1-b59f-9761ccf7d24a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.675139 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 245/503] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.680386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d80213-5f22-4cbd-8d80-c21614c46b68 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.692049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 259/504] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.692948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547cc0e-7e91-4be1-b59f-9761ccf7d24a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.696180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d80213-5f22-4cbd-8d80-c21614c46b68 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.705317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87123f-6b60-4b6f-8eac-6f2a3b320e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.705886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87123f-6b60-4b6f-8eac-6f2a3b320e37 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.706166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87123f-6b60-4b6f-8eac-6f2a3b320e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.706443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87123f-6b60-4b6f-8eac-6f2a3b320e37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.708804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547cc0e-7e91-4be1-b59f-9761ccf7d24a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.714802 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671a5d-4b7c-4c2a-9959-7a3f50e9362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.715094 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87123f-6b60-4b6f-8eac-6f2a3b320e37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.716056 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671a5d-4b7c-4c2a-9959-7a3f50e9362e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.716590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671a5d-4b7c-4c2a-9959-7a3f50e9362e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.716837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87123f-6b60-4b6f-8eac-6f2a3b320e37 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.717267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671a5d-4b7c-4c2a-9959-7a3f50e9362e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.726375 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 246/505] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:38:05.727501 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671a5d-4b7c-4c2a-9959-7a3f50e9362e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.730058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671a5d-4b7c-4c2a-9959-7a3f50e9362e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.732416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87123f-6b60-4b6f-8eac-6f2a3b320e37 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.742169 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87123f-6b60-4b6f-8eac-6f2a3b320e37 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.747001 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f865e-c339-4eca-a659-f6c027355766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.747771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f865e-c339-4eca-a659-f6c027355766 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.748049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f865e-c339-4eca-a659-f6c027355766 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.748325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f865e-c339-4eca-a659-f6c027355766 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.749557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-63671a5d-4b7c-4c2a-9959-7a3f50e9362e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 24 16:38:05.751529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 260/506] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.752597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671a5d-4b7c-4c2a-9959-7a3f50e9362e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.760009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f865e-c339-4eca-a659-f6c027355766 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.761971 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f865e-c339-4eca-a659-f6c027355766 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.767481 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671a5d-4b7c-4c2a-9959-7a3f50e9362e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.772304 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37de133-6acb-44a5-b045-f8476cf0bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.773510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37de133-6acb-44a5-b045-f8476cf0bc19 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.774012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37de133-6acb-44a5-b045-f8476cf0bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.774509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37de133-6acb-44a5-b045-f8476cf0bc19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.777345 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-711f865e-c339-4eca-a659-f6c027355766 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:05.778525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 247/507] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.779426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f865e-c339-4eca-a659-f6c027355766 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.788014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37de133-6acb-44a5-b045-f8476cf0bc19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.789752 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f865e-c339-4eca-a659-f6c027355766 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.790477 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37de133-6acb-44a5-b045-f8476cf0bc19 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.794548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994947c2-40d5-458a-96e4-f5e58cb4d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.795298 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994947c2-40d5-458a-96e4-f5e58cb4d97a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.795578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994947c2-40d5-458a-96e4-f5e58cb4d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.795902 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994947c2-40d5-458a-96e4-f5e58cb4d97a admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.796799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994947c2-40d5-458a-96e4-f5e58cb4d97a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.797103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994947c2-40d5-458a-96e4-f5e58cb4d97a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.799469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994947c2-40d5-458a-96e4-f5e58cb4d97a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.812413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-e37de133-6acb-44a5-b045-f8476cf0bc19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:05.814123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 261/508] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.815114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37de133-6acb-44a5-b045-f8476cf0bc19 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.823044 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 248/509] 10.222.0.117 () {56 vars in 1163 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.823942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994947c2-40d5-458a-96e4-f5e58cb4d97a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.826349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37de133-6acb-44a5-b045-f8476cf0bc19 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.831224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3980195-946e-43d6-b4cd-2fdcd0a456b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.831910 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3980195-946e-43d6-b4cd-2fdcd0a456b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.832190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3980195-946e-43d6-b4cd-2fdcd0a456b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.832484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3980195-946e-43d6-b4cd-2fdcd0a456b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.833275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3980195-946e-43d6-b4cd-2fdcd0a456b0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.833552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994947c2-40d5-458a-96e4-f5e58cb4d97a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.833705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3980195-946e-43d6-b4cd-2fdcd0a456b0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.834578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-b3980195-946e-43d6-b4cd-2fdcd0a456b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:05.834578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:38:05.834578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:38:05.836299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3980195-946e-43d6-b4cd-2fdcd0a456b0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.839049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380f48b-b0a6-4b35-a519-e49d9d200dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.839678 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380f48b-b0a6-4b35-a519-e49d9d200dcc admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.839958 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380f48b-b0a6-4b35-a519-e49d9d200dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.840551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380f48b-b0a6-4b35-a519-e49d9d200dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.840948 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380f48b-b0a6-4b35-a519-e49d9d200dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.841251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380f48b-b0a6-4b35-a519-e49d9d200dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.842845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380f48b-b0a6-4b35-a519-e49d9d200dcc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.859932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 262/510] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.859932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee882eef-2a96-4dba-be5c-d42724139f8e None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.859932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee882eef-2a96-4dba-be5c-d42724139f8e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.859932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee882eef-2a96-4dba-be5c-d42724139f8e None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.859932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 263/511] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:05.859932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee882eef-2a96-4dba-be5c-d42724139f8e None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.860817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 249/512] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.863126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380f48b-b0a6-4b35-a519-e49d9d200dcc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.871912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380f48b-b0a6-4b35-a519-e49d9d200dcc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.873656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee882eef-2a96-4dba-be5c-d42724139f8e None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.876179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce1407-4825-40cb-bccd-32218cf7d2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.876774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce1407-4825-40cb-bccd-32218cf7d2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.877055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce1407-4825-40cb-bccd-32218cf7d2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.877341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce1407-4825-40cb-bccd-32218cf7d2a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.878065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958d071-06d3-4edb-8189-315f4b2c496d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.878175 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce1407-4825-40cb-bccd-32218cf7d2a4 admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=37c91fefe89a45b48df82a311e771ea3) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.878459 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce1407-4825-40cb-bccd-32218cf7d2a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.878660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d071-06d3-4edb-8189-315f4b2c496d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.878980 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d071-06d3-4edb-8189-315f4b2c496d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.879253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d071-06d3-4edb-8189-315f4b2c496d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.880321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce1407-4825-40cb-bccd-32218cf7d2a4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.890794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 250/513] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/role_assignments?user.id=37c91fefe89a45b48df82a311e771ea3&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 260 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:05.890794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce1407-4825-40cb-bccd-32218cf7d2a4 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.896312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce1407-4825-40cb-bccd-32218cf7d2a4 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.899876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958d071-06d3-4edb-8189-315f4b2c496d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.901673 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958d071-06d3-4edb-8189-315f4b2c496d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.901916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfadd0-ecf4-454a-934d-310a1378c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.902706 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfadd0-ecf4-454a-934d-310a1378c933 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.903017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfadd0-ecf4-454a-934d-310a1378c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.903294 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfadd0-ecf4-454a-934d-310a1378c933 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.910929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfadd0-ecf4-454a-934d-310a1378c933 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.912930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfadd0-ecf4-454a-934d-310a1378c933 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.914813 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 264/514] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:38:05.917022 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dc00f-0458-402e-960b-4003f4293577 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.917534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dc00f-0458-402e-960b-4003f4293577 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.918003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dc00f-0458-402e-960b-4003f4293577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.928436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-07dfadd0-ecf4-454a-934d-310a1378c933 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:05.930336 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 251/515] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:05.935636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfadd0-ecf4-454a-934d-310a1378c933 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.940582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-e55dc00f-0458-402e-960b-4003f4293577 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:05.943375 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e55dc00f-0458-402e-960b-4003f4293577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:05.949122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfadd0-ecf4-454a-934d-310a1378c933 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.962944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd761181-0e96-4f03-9c2f-2cd914a86a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.963142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 265/516] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:05 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:05.963142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dc00f-0458-402e-960b-4003f4293577 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:05.963825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761181-0e96-4f03-9c2f-2cd914a86a3d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.964111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761181-0e96-4f03-9c2f-2cd914a86a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.964389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761181-0e96-4f03-9c2f-2cd914a86a3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.981409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dc00f-0458-402e-960b-4003f4293577 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:05.987574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd761181-0e96-4f03-9c2f-2cd914a86a3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.990682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd761181-0e96-4f03-9c2f-2cd914a86a3d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:05.994348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdc2e9-026a-4bf3-b999-1c8ee3b36b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:05.995052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc2e9-026a-4bf3-b999-1c8ee3b36b7a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:05.995333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc2e9-026a-4bf3-b999-1c8ee3b36b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:05.995604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc2e9-026a-4bf3-b999-1c8ee3b36b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:05.996586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdc2e9-026a-4bf3-b999-1c8ee3b36b7a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:05.996728 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdc2e9-026a-4bf3-b999-1c8ee3b36b7a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:05.998590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdc2e9-026a-4bf3-b999-1c8ee3b36b7a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.014889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 266/517] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:06.015275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-cd761181-0e96-4f03-9c2f-2cd914a86a3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:06.015832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdc2e9-026a-4bf3-b999-1c8ee3b36b7a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.017354 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 252/518] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:06.023507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd761181-0e96-4f03-9c2f-2cd914a86a3d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.033151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdc2e9-026a-4bf3-b999-1c8ee3b36b7a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.036912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd761181-0e96-4f03-9c2f-2cd914a86a3d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.037949 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b2a0d-64ab-4d50-8e73-a2b16b3a6f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.039528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b2a0d-64ab-4d50-8e73-a2b16b3a6f6c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.039913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b2a0d-64ab-4d50-8e73-a2b16b3a6f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.040281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b2a0d-64ab-4d50-8e73-a2b16b3a6f6c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.043434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0e8ad-b3ae-4305-8c88-d8dcb8d43b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.044333 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0e8ad-b3ae-4305-8c88-d8dcb8d43b90 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.044783 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0e8ad-b3ae-4305-8c88-d8dcb8d43b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.045198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0e8ad-b3ae-4305-8c88-d8dcb8d43b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.046171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0e8ad-b3ae-4305-8c88-d8dcb8d43b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:06.046621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0e8ad-b3ae-4305-8c88-d8dcb8d43b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.048574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0e8ad-b3ae-4305-8c88-d8dcb8d43b90 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.053605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b2a0d-64ab-4d50-8e73-a2b16b3a6f6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:06.061011 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-c41b2a0d-64ab-4d50-8e73-a2b16b3a6f6c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:06.062463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 267/520] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:06.062657 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 253/520] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:06.067487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b2a0d-64ab-4d50-8e73-a2b16b3a6f6c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.068130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0e8ad-b3ae-4305-8c88-d8dcb8d43b90 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.079134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b2a0d-64ab-4d50-8e73-a2b16b3a6f6c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.079509 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0e8ad-b3ae-4305-8c88-d8dcb8d43b90 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.086101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c7003-b9c7-4461-9958-439b7986a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.086949 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c7003-b9c7-4461-9958-439b7986a4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.087240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c7003-b9c7-4461-9958-439b7986a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.087501 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c7003-b9c7-4461-9958-439b7986a4d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.088389 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c7003-b9c7-4461-9958-439b7986a4d8 admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=3c62250938c543d788dd7fd690b5abad) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:06.088699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c7003-b9c7-4461-9958-439b7986a4d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.089306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060cdea-c755-4569-801d-7da5054a0b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.090792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060cdea-c755-4569-801d-7da5054a0b4a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.090918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c7003-b9c7-4461-9958-439b7986a4d8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.091360 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060cdea-c755-4569-801d-7da5054a0b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.091637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060cdea-c755-4569-801d-7da5054a0b4a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.097041 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 268/521] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/role_assignments?user.id=3c62250938c543d788dd7fd690b5abad&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:06.097843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c7003-b9c7-4461-9958-439b7986a4d8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.108281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c7003-b9c7-4461-9958-439b7986a4d8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.109530 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060cdea-c755-4569-801d-7da5054a0b4a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.111949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060cdea-c755-4569-801d-7da5054a0b4a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.114829 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012bc66-2353-49df-8047-e88b45b6dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.115686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012bc66-2353-49df-8047-e88b45b6dc97 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.116200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012bc66-2353-49df-8047-e88b45b6dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.116773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012bc66-2353-49df-8047-e88b45b6dc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.117698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012bc66-2353-49df-8047-e88b45b6dc97 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:06.118346 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012bc66-2353-49df-8047-e88b45b6dc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.120267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012bc66-2353-49df-8047-e88b45b6dc97 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.130382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 269/522] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:06.136826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012bc66-2353-49df-8047-e88b45b6dc97 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.147550 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012bc66-2353-49df-8047-e88b45b6dc97 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.151067 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-6060cdea-c755-4569-801d-7da5054a0b4a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:06.152874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 254/523] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:06.153552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dbaff-e772-4c77-88d7-f14909a3cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.154559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dbaff-e772-4c77-88d7-f14909a3cbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.154999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dbaff-e772-4c77-88d7-f14909a3cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.155453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dbaff-e772-4c77-88d7-f14909a3cbd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.159798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060cdea-c755-4569-801d-7da5054a0b4a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.170377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dbaff-e772-4c77-88d7-f14909a3cbd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.172520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dbaff-e772-4c77-88d7-f14909a3cbd0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.185029 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060cdea-c755-4569-801d-7da5054a0b4a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.192204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-734dbaff-e772-4c77-88d7-f14909a3cbd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:06.193971 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 270/524] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:06.195130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f428ef-ac0b-4454-8212-faf377ab6d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.196173 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f428ef-ac0b-4454-8212-faf377ab6d0f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.196679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f428ef-ac0b-4454-8212-faf377ab6d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.197381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f428ef-ac0b-4454-8212-faf377ab6d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.198461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f428ef-ac0b-4454-8212-faf377ab6d0f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:06.198794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f428ef-ac0b-4454-8212-faf377ab6d0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.200370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dbaff-e772-4c77-88d7-f14909a3cbd0 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.207008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-00f428ef-ac0b-4454-8212-faf377ab6d0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:06.207008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:38:06.207008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:38:06.208169 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f428ef-ac0b-4454-8212-faf377ab6d0f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.218638 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dbaff-e772-4c77-88d7-f14909a3cbd0 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.223363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ce3b6-a525-4673-8a40-b2876f5bf238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.224037 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ce3b6-a525-4673-8a40-b2876f5bf238 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.224317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ce3b6-a525-4673-8a40-b2876f5bf238 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.224590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ce3b6-a525-4673-8a40-b2876f5bf238 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.225336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ce3b6-a525-4673-8a40-b2876f5bf238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:06.225642 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ce3b6-a525-4673-8a40-b2876f5bf238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.232140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ce3b6-a525-4673-8a40-b2876f5bf238 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.247990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 271/525] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:06.249614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ce3b6-a525-4673-8a40-b2876f5bf238 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.256816 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 255/526] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:06.260264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ce3b6-a525-4673-8a40-b2876f5bf238 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.263504 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f428ef-ac0b-4454-8212-faf377ab6d0f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.265160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786f5eb-5b66-4644-abf3-9b53007bd599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.266028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786f5eb-5b66-4644-abf3-9b53007bd599 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.266377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786f5eb-5b66-4644-abf3-9b53007bd599 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.266715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786f5eb-5b66-4644-abf3-9b53007bd599 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.275719 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786f5eb-5b66-4644-abf3-9b53007bd599 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.278589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786f5eb-5b66-4644-abf3-9b53007bd599 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.285024 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f428ef-ac0b-4454-8212-faf377ab6d0f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.294892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-7786f5eb-5b66-4644-abf3-9b53007bd599 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 24 16:38:06.296517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 272/527] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:06.297870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b383797-3e28-4cc9-8659-bb5700a45fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.298729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b383797-3e28-4cc9-8659-bb5700a45fcc admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.299177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b383797-3e28-4cc9-8659-bb5700a45fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.299574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b383797-3e28-4cc9-8659-bb5700a45fcc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.300562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b383797-3e28-4cc9-8659-bb5700a45fcc admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=2691f7bb4ed84de4bb5901710a96d766) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:06.301232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b383797-3e28-4cc9-8659-bb5700a45fcc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.302019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786f5eb-5b66-4644-abf3-9b53007bd599 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.303658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b383797-3e28-4cc9-8659-bb5700a45fcc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.314402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786f5eb-5b66-4644-abf3-9b53007bd599 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.319864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6fc7d-19f1-4f59-80fe-3c5f528387b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.320597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fc7d-19f1-4f59-80fe-3c5f528387b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.320731 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 256/528] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/role_assignments?user.id=2691f7bb4ed84de4bb5901710a96d766&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 260 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:06.320991 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fc7d-19f1-4f59-80fe-3c5f528387b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.321333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fc7d-19f1-4f59-80fe-3c5f528387b6 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.322353 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6fc7d-19f1-4f59-80fe-3c5f528387b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:06.322721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6fc7d-19f1-4f59-80fe-3c5f528387b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.324691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6fc7d-19f1-4f59-80fe-3c5f528387b6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.345754 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 273/529] 10.222.0.117 () {56 vars in 1165 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:06.352154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b383797-3e28-4cc9-8659-bb5700a45fcc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.364536 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b383797-3e28-4cc9-8659-bb5700a45fcc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.370572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed817660-2d30-455d-811c-3b737144b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.371601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817660-2d30-455d-811c-3b737144b92f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.372061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817660-2d30-455d-811c-3b737144b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.372510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817660-2d30-455d-811c-3b737144b92f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.381394 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed817660-2d30-455d-811c-3b737144b92f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.384243 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed817660-2d30-455d-811c-3b737144b92f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.394491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 257/530] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:38:06.402413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6fc7d-19f1-4f59-80fe-3c5f528387b6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.421507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6fc7d-19f1-4f59-80fe-3c5f528387b6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.431857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50064783-f29d-422c-b703-0b3f688f280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.432666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50064783-f29d-422c-b703-0b3f688f280c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.432948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50064783-f29d-422c-b703-0b3f688f280c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.433223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50064783-f29d-422c-b703-0b3f688f280c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.456774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50064783-f29d-422c-b703-0b3f688f280c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.458735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50064783-f29d-422c-b703-0b3f688f280c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.483683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-50064783-f29d-422c-b703-0b3f688f280c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:06.485267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 274/531] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:06.490456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed817660-2d30-455d-811c-3b737144b92f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.504729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed817660-2d30-455d-811c-3b737144b92f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.512258 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fe3ed-7dda-48d7-b245-415ea42e4dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.513170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe3ed-7dda-48d7-b245-415ea42e4dfb admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.513597 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe3ed-7dda-48d7-b245-415ea42e4dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.514014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe3ed-7dda-48d7-b245-415ea42e4dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.514924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fe3ed-7dda-48d7-b245-415ea42e4dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:06.515371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fe3ed-7dda-48d7-b245-415ea42e4dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.517130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fe3ed-7dda-48d7-b245-415ea42e4dfb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.536353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 258/532] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:06.542507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50064783-f29d-422c-b703-0b3f688f280c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.556682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50064783-f29d-422c-b703-0b3f688f280c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.567704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcc164-b564-4e0a-a7d0-b0040f8d0ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.568644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc164-b564-4e0a-a7d0-b0040f8d0ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.569036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc164-b564-4e0a-a7d0-b0040f8d0ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.569368 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc164-b564-4e0a-a7d0-b0040f8d0ed7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.580627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcc164-b564-4e0a-a7d0-b0040f8d0ed7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.582685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcc164-b564-4e0a-a7d0-b0040f8d0ed7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.598951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-fbdcc164-b564-4e0a-a7d0-b0040f8d0ed7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:06.600677 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 275/533] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:06.606198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fe3ed-7dda-48d7-b245-415ea42e4dfb admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.617351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fe3ed-7dda-48d7-b245-415ea42e4dfb admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.622445 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c838a-863f-4b13-ad38-92404c92d158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.624269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c838a-863f-4b13-ad38-92404c92d158 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.624727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c838a-863f-4b13-ad38-92404c92d158 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.625207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c838a-863f-4b13-ad38-92404c92d158 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.626178 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c838a-863f-4b13-ad38-92404c92d158 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:06.626716 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c838a-863f-4b13-ad38-92404c92d158 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.628869 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c838a-863f-4b13-ad38-92404c92d158 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.643614 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 259/534] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:06.649392 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcc164-b564-4e0a-a7d0-b0040f8d0ed7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.666284 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcc164-b564-4e0a-a7d0-b0040f8d0ed7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.674836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f684a8c-eba7-4c46-8049-b610f75330ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.675474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f684a8c-eba7-4c46-8049-b610f75330ba admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.675754 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f684a8c-eba7-4c46-8049-b610f75330ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.676026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f684a8c-eba7-4c46-8049-b610f75330ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.676864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f684a8c-eba7-4c46-8049-b610f75330ba admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=aa9834b75e2b4ac787f3917564090d2d) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:06.677170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f684a8c-eba7-4c46-8049-b610f75330ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.679583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f684a8c-eba7-4c46-8049-b610f75330ba admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.691098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 276/535] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/role_assignments?user.id=aa9834b75e2b4ac787f3917564090d2d&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:06.795755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db51f42-f86d-4f2e-a20c-7f902b39d6e2 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.796347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db51f42-f86d-4f2e-a20c-7f902b39d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.796835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db51f42-f86d-4f2e-a20c-7f902b39d6e2 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.798950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 260/536] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:06.805341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287895b8-f07b-4e7a-b28c-899616f0cdc9 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.805628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287895b8-f07b-4e7a-b28c-899616f0cdc9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.805903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287895b8-f07b-4e7a-b28c-899616f0cdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.836744 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-287895b8-f07b-4e7a-b28c-899616f0cdc9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:06.837992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-287895b8-f07b-4e7a-b28c-899616f0cdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:06.846714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 277/537] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:06 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:06.877992 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db51f42-f86d-4f2e-a20c-7f902b39d6e2 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.897321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db51f42-f86d-4f2e-a20c-7f902b39d6e2 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.902782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e223-746a-4932-a394-3e4a192c0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.903861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e223-746a-4932-a394-3e4a192c0f06 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.904316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e223-746a-4932-a394-3e4a192c0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.904808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e223-746a-4932-a394-3e4a192c0f06 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.919499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e223-746a-4932-a394-3e4a192c0f06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.921776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e223-746a-4932-a394-3e4a192c0f06 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.941534 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-d8f0e223-746a-4932-a394-3e4a192c0f06 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:06.943049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 261/538] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:06.948979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287895b8-f07b-4e7a-b28c-899616f0cdc9 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:06.958700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287895b8-f07b-4e7a-b28c-899616f0cdc9 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:06.963832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c87cb-9356-4d0b-ac9b-ec377d999c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:06.964701 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c87cb-9356-4d0b-ac9b-ec377d999c28 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:06.965158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c87cb-9356-4d0b-ac9b-ec377d999c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:06.965623 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c87cb-9356-4d0b-ac9b-ec377d999c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:06.966536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c87cb-9356-4d0b-ac9b-ec377d999c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:06.967052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c87cb-9356-4d0b-ac9b-ec377d999c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:06.968969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c87cb-9356-4d0b-ac9b-ec377d999c28 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:06.982558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 278/539] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:06.991157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e223-746a-4932-a394-3e4a192c0f06 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:07.004222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e223-746a-4932-a394-3e4a192c0f06 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:07.014609 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241f331-f61d-479f-b930-cde53f0c8fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:07.015361 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241f331-f61d-479f-b930-cde53f0c8fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:07.015643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241f331-f61d-479f-b930-cde53f0c8fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:07.015921 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241f331-f61d-479f-b930-cde53f0c8fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:07.016710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241f331-f61d-479f-b930-cde53f0c8fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:07.018716 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241f331-f61d-479f-b930-cde53f0c8fd5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:07.049019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 262/540] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:38:06 2022] POST /identity/v3/users => generated 248 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:08.764930 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47f0d-4d17-4208-81fa-f6b6916d1594 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:08.765447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47f0d-4d17-4208-81fa-f6b6916d1594 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:08.765625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47f0d-4d17-4208-81fa-f6b6916d1594 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:08.767552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 279/541] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:08.773233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72e6f8-e85a-455c-8f15-c45d13d7bf51 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:08.773923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72e6f8-e85a-455c-8f15-c45d13d7bf51 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:08.773923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72e6f8-e85a-455c-8f15-c45d13d7bf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:08.797484 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ad72e6f8-e85a-455c-8f15-c45d13d7bf51 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:08.799045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ad72e6f8-e85a-455c-8f15-c45d13d7bf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:08.812946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 263/542] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:08 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:08.847848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba47f0d-4d17-4208-81fa-f6b6916d1594 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:08.864624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba47f0d-4d17-4208-81fa-f6b6916d1594 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:08.875084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44588698-a54f-4fda-99f7-4769a2c16ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:08.875909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44588698-a54f-4fda-99f7-4769a2c16ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:08.876195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44588698-a54f-4fda-99f7-4769a2c16ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:08.876470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44588698-a54f-4fda-99f7-4769a2c16ea4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:08.898002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44588698-a54f-4fda-99f7-4769a2c16ea4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:08.905543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-44588698-a54f-4fda-99f7-4769a2c16ea4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:08.907129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 280/543] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:08.912528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72e6f8-e85a-455c-8f15-c45d13d7bf51 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:08.922915 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72e6f8-e85a-455c-8f15-c45d13d7bf51 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:08.934951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aabbd4-0e28-4885-8c62-8474081b01bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:08.935916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aabbd4-0e28-4885-8c62-8474081b01bb admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:08.936392 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aabbd4-0e28-4885-8c62-8474081b01bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:08.936859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aabbd4-0e28-4885-8c62-8474081b01bb admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:08.937832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aabbd4-0e28-4885-8c62-8474081b01bb admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:08.938353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aabbd4-0e28-4885-8c62-8474081b01bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:08.940205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aabbd4-0e28-4885-8c62-8474081b01bb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:08.954347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 264/544] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:08 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:08.959666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44588698-a54f-4fda-99f7-4769a2c16ea4 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:08.976428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44588698-a54f-4fda-99f7-4769a2c16ea4 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:08.982829 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2160-4cc2-4b2a-a9f2-67cd6ea2d3e1 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:08.983485 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2160-4cc2-4b2a-a9f2-67cd6ea2d3e1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:08.984029 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2160-4cc2-4b2a-a9f2-67cd6ea2d3e1 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:08.986456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 265/545] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:08.987832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce4c62-0029-4c84-b1ef-a1522cbc4fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:08.987962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce4c62-0029-4c84-b1ef-a1522cbc4fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:08.988164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce4c62-0029-4c84-b1ef-a1522cbc4fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:08.988416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce4c62-0029-4c84-b1ef-a1522cbc4fd2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:08.993621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbc448-edf1-4d34-a2f5-a82d88c0e889 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:08.999100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbc448-edf1-4d34-a2f5-a82d88c0e889 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:08.999601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbc448-edf1-4d34-a2f5-a82d88c0e889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.010783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce4c62-0029-4c84-b1ef-a1522cbc4fd2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.014399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce4c62-0029-4c84-b1ef-a1522cbc4fd2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.033370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-89bbc448-edf1-4d34-a2f5-a82d88c0e889 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:09.037412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-89bbc448-edf1-4d34-a2f5-a82d88c0e889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:09.046320 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-48ce4c62-0029-4c84-b1ef-a1522cbc4fd2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:09.050781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 281/547] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.051041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 266/547] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:08 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:38:09.052899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce4c62-0029-4c84-b1ef-a1522cbc4fd2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.066976 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce4c62-0029-4c84-b1ef-a1522cbc4fd2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.076300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbc448-edf1-4d34-a2f5-a82d88c0e889 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.076463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944f472-d17c-4b2e-bff9-bee34956c386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.076987 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f472-d17c-4b2e-bff9-bee34956c386 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.077267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f472-d17c-4b2e-bff9-bee34956c386 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.077540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f472-d17c-4b2e-bff9-bee34956c386 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.078282 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944f472-d17c-4b2e-bff9-bee34956c386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.078584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944f472-d17c-4b2e-bff9-bee34956c386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.080189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944f472-d17c-4b2e-bff9-bee34956c386 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.088689 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbc448-edf1-4d34-a2f5-a82d88c0e889 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.093919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22fb4-aded-4641-88da-74181091618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.094993 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22fb4-aded-4641-88da-74181091618b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.095497 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22fb4-aded-4641-88da-74181091618b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.095981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22fb4-aded-4641-88da-74181091618b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.099762 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 282/548] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:09.104868 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944f472-d17c-4b2e-bff9-bee34956c386 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.110516 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a22fb4-aded-4641-88da-74181091618b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:09.119717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-43a22fb4-aded-4641-88da-74181091618b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:09.124840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944f472-d17c-4b2e-bff9-bee34956c386 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.125106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 267/549] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.127685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22fb4-aded-4641-88da-74181091618b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.138741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22fb4-aded-4641-88da-74181091618b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.143495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ca40e-8418-49b4-afdd-588060091611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.145291 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ca40e-8418-49b4-afdd-588060091611 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.146922 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ca40e-8418-49b4-afdd-588060091611 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.149026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ca40e-8418-49b4-afdd-588060091611 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.151495 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883465c-df39-4ac1-b122-09a0136d8046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.153649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883465c-df39-4ac1-b122-09a0136d8046 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.154464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883465c-df39-4ac1-b122-09a0136d8046 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.156306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883465c-df39-4ac1-b122-09a0136d8046 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.157403 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883465c-df39-4ac1-b122-09a0136d8046 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.158911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883465c-df39-4ac1-b122-09a0136d8046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.161908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883465c-df39-4ac1-b122-09a0136d8046 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.168868 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ca40e-8418-49b4-afdd-588060091611 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.170957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ca40e-8418-49b4-afdd-588060091611 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.182821 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 268/550] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:09.192972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ecb72-c13e-4cfe-94eb-a196010363c4 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.193267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ecb72-c13e-4cfe-94eb-a196010363c4 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.193527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ecb72-c13e-4cfe-94eb-a196010363c4 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.196374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 269/551] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:09.197157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ecb72-c13e-4cfe-94eb-a196010363c4 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.204223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-595ca40e-8418-49b4-afdd-588060091611 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 24 16:38:09.205714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 283/552] 10.222.0.117 () {56 vars in 1119 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.207012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19521445-f77e-4886-a8f2-51145197ae0b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.207296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19521445-f77e-4886-a8f2-51145197ae0b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.207567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19521445-f77e-4886-a8f2-51145197ae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.215069 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ecb72-c13e-4cfe-94eb-a196010363c4 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.223014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c6247-7e25-4d39-9dec-4b131fedcd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.224076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c6247-7e25-4d39-9dec-4b131fedcd8c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.224353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c6247-7e25-4d39-9dec-4b131fedcd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.224629 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c6247-7e25-4d39-9dec-4b131fedcd8c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.227937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-19521445-f77e-4886-a8f2-51145197ae0b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:09.229166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-19521445-f77e-4886-a8f2-51145197ae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:09.236561 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c6247-7e25-4d39-9dec-4b131fedcd8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.237703 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 284/553] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:09 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:09.238602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c6247-7e25-4d39-9dec-4b131fedcd8c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.238730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19521445-f77e-4886-a8f2-51145197ae0b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.248207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19521445-f77e-4886-a8f2-51145197ae0b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.252870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b0611-ee3f-4cb6-aa83-ee544ccbc3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.253561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b0611-ee3f-4cb6-aa83-ee544ccbc3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.253889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b0611-ee3f-4cb6-aa83-ee544ccbc3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.254156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b0611-ee3f-4cb6-aa83-ee544ccbc3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.255074 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b0611-ee3f-4cb6-aa83-ee544ccbc3a2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.255376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b0611-ee3f-4cb6-aa83-ee544ccbc3a2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.258246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b0611-ee3f-4cb6-aa83-ee544ccbc3a2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.260396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-a29c6247-7e25-4d39-9dec-4b131fedcd8c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:09.262713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 270/554] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.267892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c6247-7e25-4d39-9dec-4b131fedcd8c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.279998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 285/555] 10.222.0.117 () {56 vars in 1159 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:09.280942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b0611-ee3f-4cb6-aa83-ee544ccbc3a2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.281182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c6247-7e25-4d39-9dec-4b131fedcd8c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.286315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71886336-8444-41ad-a593-307afdeecf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.286944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886336-8444-41ad-a593-307afdeecf3e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.287224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886336-8444-41ad-a593-307afdeecf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.287496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886336-8444-41ad-a593-307afdeecf3e admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.288423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71886336-8444-41ad-a593-307afdeecf3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.289144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71886336-8444-41ad-a593-307afdeecf3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.290924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71886336-8444-41ad-a593-307afdeecf3e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.296714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b0611-ee3f-4cb6-aa83-ee544ccbc3a2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.301507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebabba1-d5a2-4641-aae6-86821c58cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.302440 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebabba1-d5a2-4641-aae6-86821c58cc52 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.302803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebabba1-d5a2-4641-aae6-86821c58cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.303144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebabba1-d5a2-4641-aae6-86821c58cc52 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.304880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 271/556] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:09.306056 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71886336-8444-41ad-a593-307afdeecf3e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.314581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebabba1-d5a2-4641-aae6-86821c58cc52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:09.317533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71886336-8444-41ad-a593-307afdeecf3e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.322493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-7ebabba1-d5a2-4641-aae6-86821c58cc52 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:09.322912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeeee4a-052f-4bc2-b778-2be740a1feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.323681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeee4a-052f-4bc2-b778-2be740a1feb1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.324000 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 286/557] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.324812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebabba1-d5a2-4641-aae6-86821c58cc52 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.326890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeee4a-052f-4bc2-b778-2be740a1feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.327247 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeee4a-052f-4bc2-b778-2be740a1feb1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.339457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebabba1-d5a2-4641-aae6-86821c58cc52 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.344676 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060443e6-407f-46e9-82cd-8f1682905f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.345595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060443e6-407f-46e9-82cd-8f1682905f3c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.345871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060443e6-407f-46e9-82cd-8f1682905f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.346181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060443e6-407f-46e9-82cd-8f1682905f3c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.347046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeeee4a-052f-4bc2-b778-2be740a1feb1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.350255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeeee4a-052f-4bc2-b778-2be740a1feb1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.355405 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060443e6-407f-46e9-82cd-8f1682905f3c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.357442 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060443e6-407f-46e9-82cd-8f1682905f3c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.369838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-fdeeee4a-052f-4bc2-b778-2be740a1feb1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:09.371412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 272/558] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.371593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-060443e6-407f-46e9-82cd-8f1682905f3c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 24 16:38:09.372193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeeee4a-052f-4bc2-b778-2be740a1feb1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.372604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 287/559] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.378186 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060443e6-407f-46e9-82cd-8f1682905f3c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.385359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeeee4a-052f-4bc2-b778-2be740a1feb1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.388451 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060443e6-407f-46e9-82cd-8f1682905f3c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.391080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505fb60-6231-47f6-9ea6-94c5a06251be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.392696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505fb60-6231-47f6-9ea6-94c5a06251be admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.393164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505fb60-6231-47f6-9ea6-94c5a06251be admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.393612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505fb60-6231-47f6-9ea6-94c5a06251be admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.393715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c9ddd-3424-4c64-ae4f-76e08a4b9e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.394409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c9ddd-3424-4c64-ae4f-76e08a4b9e58 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.394689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c9ddd-3424-4c64-ae4f-76e08a4b9e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.394989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c9ddd-3424-4c64-ae4f-76e08a4b9e58 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.395241 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505fb60-6231-47f6-9ea6-94c5a06251be admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.395736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505fb60-6231-47f6-9ea6-94c5a06251be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.395835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c9ddd-3424-4c64-ae4f-76e08a4b9e58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.396105 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c9ddd-3424-4c64-ae4f-76e08a4b9e58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.398343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505fb60-6231-47f6-9ea6-94c5a06251be admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.398508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c9ddd-3424-4c64-ae4f-76e08a4b9e58 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.415513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 273/561] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:09.415817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 288/561] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:09.416747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c9ddd-3424-4c64-ae4f-76e08a4b9e58 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.417062 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505fb60-6231-47f6-9ea6-94c5a06251be admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.427126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c9ddd-3424-4c64-ae4f-76e08a4b9e58 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.429795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505fb60-6231-47f6-9ea6-94c5a06251be admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.432290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34feb8a-a4c0-4cde-ae7b-66cbc56f7a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.432936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34feb8a-a4c0-4cde-ae7b-66cbc56f7a46 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.433214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34feb8a-a4c0-4cde-ae7b-66cbc56f7a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.433483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34feb8a-a4c0-4cde-ae7b-66cbc56f7a46 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.434346 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34feb8a-a4c0-4cde-ae7b-66cbc56f7a46 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.434625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34feb8a-a4c0-4cde-ae7b-66cbc56f7a46 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.436119 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7dfa-8121-47c5-bc6e-ce01b2e6f672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.436494 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34feb8a-a4c0-4cde-ae7b-66cbc56f7a46 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.437355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7dfa-8121-47c5-bc6e-ce01b2e6f672 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.437867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7dfa-8121-47c5-bc6e-ce01b2e6f672 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.438486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7dfa-8121-47c5-bc6e-ce01b2e6f672 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.449454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d7dfa-8121-47c5-bc6e-ce01b2e6f672 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.452211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d7dfa-8121-47c5-bc6e-ce01b2e6f672 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.455046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 289/562] 10.222.0.117 () {56 vars in 1163 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:09.456021 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34feb8a-a4c0-4cde-ae7b-66cbc56f7a46 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.465809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34feb8a-a4c0-4cde-ae7b-66cbc56f7a46 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.469226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-351d7dfa-8121-47c5-bc6e-ce01b2e6f672 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:09.470689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce97ce8-2bd6-44d5-a4c3-fbb57fdca29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.470951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 274/563] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.471539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97ce8-2bd6-44d5-a4c3-fbb57fdca29a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.472216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7dfa-8121-47c5-bc6e-ce01b2e6f672 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.475630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97ce8-2bd6-44d5-a4c3-fbb57fdca29a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.476191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97ce8-2bd6-44d5-a4c3-fbb57fdca29a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.484707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7dfa-8121-47c5-bc6e-ce01b2e6f672 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.489177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b80d3-9874-4156-bf5c-860f2eb3073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.489942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b80d3-9874-4156-bf5c-860f2eb3073c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.490224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b80d3-9874-4156-bf5c-860f2eb3073c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.490499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b80d3-9874-4156-bf5c-860f2eb3073c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.495268 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce97ce8-2bd6-44d5-a4c3-fbb57fdca29a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.497158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce97ce8-2bd6-44d5-a4c3-fbb57fdca29a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.502674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b80d3-9874-4156-bf5c-860f2eb3073c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.504513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b80d3-9874-4156-bf5c-860f2eb3073c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.514847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-4ce97ce8-2bd6-44d5-a4c3-fbb57fdca29a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:09.516033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 290/564] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.517254 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d253cb0-35f4-4c5b-8126-243820d16858 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.517534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d253cb0-35f4-4c5b-8126-243820d16858 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.517804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d253cb0-35f4-4c5b-8126-243820d16858 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.522939 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 291/565] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:09 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:09.524296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d253cb0-35f4-4c5b-8126-243820d16858 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.525743 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-316b80d3-9874-4156-bf5c-860f2eb3073c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:09.530864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 275/566] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.530864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b80d3-9874-4156-bf5c-860f2eb3073c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.541942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d253cb0-35f4-4c5b-8126-243820d16858 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.543817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b80d3-9874-4156-bf5c-860f2eb3073c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.546218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29a186-ef60-4cab-9811-fa48f6eeae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.546906 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29a186-ef60-4cab-9811-fa48f6eeae12 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.547191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29a186-ef60-4cab-9811-fa48f6eeae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.547460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29a186-ef60-4cab-9811-fa48f6eeae12 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.548247 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29a186-ef60-4cab-9811-fa48f6eeae12 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.548446 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc8bc9-926b-49c2-bcc7-cd4c4d55ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.548553 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29a186-ef60-4cab-9811-fa48f6eeae12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.549068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc8bc9-926b-49c2-bcc7-cd4c4d55ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.549341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc8bc9-926b-49c2-bcc7-cd4c4d55ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.549611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc8bc9-926b-49c2-bcc7-cd4c4d55ab4e admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.550337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc8bc9-926b-49c2-bcc7-cd4c4d55ab4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.550429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29a186-ef60-4cab-9811-fa48f6eeae12 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.550636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc8bc9-926b-49c2-bcc7-cd4c4d55ab4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.552224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc8bc9-926b-49c2-bcc7-cd4c4d55ab4e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.563647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 292/567] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:09.568727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 276/568] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:09.568727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc8bc9-926b-49c2-bcc7-cd4c4d55ab4e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.568936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496afb8-406a-4ed0-bc60-f586145317f9 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.568936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496afb8-406a-4ed0-bc60-f586145317f9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.568936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496afb8-406a-4ed0-bc60-f586145317f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.579718 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc8bc9-926b-49c2-bcc7-cd4c4d55ab4e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.583937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e20989-7757-4c80-84e8-02e412affc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.584613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e20989-7757-4c80-84e8-02e412affc25 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.584892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e20989-7757-4c80-84e8-02e412affc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.585211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e20989-7757-4c80-84e8-02e412affc25 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.586052 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e20989-7757-4c80-84e8-02e412affc25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.586348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e20989-7757-4c80-84e8-02e412affc25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.587979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e20989-7757-4c80-84e8-02e412affc25 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.590535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-8496afb8-406a-4ed0-bc60-f586145317f9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:09.591492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8496afb8-406a-4ed0-bc60-f586145317f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:09.599362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 293/569] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:09 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:09.599968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 277/570] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:09.600633 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e20989-7757-4c80-84e8-02e412affc25 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.603567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496afb8-406a-4ed0-bc60-f586145317f9 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.610131 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e20989-7757-4c80-84e8-02e412affc25 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.615263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c83466-5ae5-4da3-a521-019c85b3d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.615775 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496afb8-406a-4ed0-bc60-f586145317f9 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.616130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c83466-5ae5-4da3-a521-019c85b3d571 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.617146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c83466-5ae5-4da3-a521-019c85b3d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.617416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c83466-5ae5-4da3-a521-019c85b3d571 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.622583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b7e4a-8d36-4551-8b9d-61385ab575d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.623734 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b7e4a-8d36-4551-8b9d-61385ab575d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.624219 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b7e4a-8d36-4551-8b9d-61385ab575d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.625015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b7e4a-8d36-4551-8b9d-61385ab575d4 admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/37c91fefe89a45b48df82a311e771ea3/roles/adcc0add18bc4deebfb1e1785ed0297b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.625619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c83466-5ae5-4da3-a521-019c85b3d571 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.627845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c83466-5ae5-4da3-a521-019c85b3d571 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.641777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b7e4a-8d36-4551-8b9d-61385ab575d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=37c91fefe89a45b48df82a311e771ea3, role_id=adcc0add18bc4deebfb1e1785ed0297b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.642199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-a0c83466-5ae5-4da3-a521-019c85b3d571 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 24 16:38:09.647748 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 278/571] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.647748 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c83466-5ae5-4da3-a521-019c85b3d571 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.647970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b7e4a-8d36-4551-8b9d-61385ab575d4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.657898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 294/572] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:38:09 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/37c91fefe89a45b48df82a311e771ea3/roles/adcc0add18bc4deebfb1e1785ed0297b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:38:09.658036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c83466-5ae5-4da3-a521-019c85b3d571 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.658663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b7e4a-8d36-4551-8b9d-61385ab575d4 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.725002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563159f-23a8-4284-a93a-4612bca22881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.726222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563159f-23a8-4284-a93a-4612bca22881 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.726695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563159f-23a8-4284-a93a-4612bca22881 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.727162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563159f-23a8-4284-a93a-4612bca22881 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.738602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563159f-23a8-4284-a93a-4612bca22881 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.740373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b7e4a-8d36-4551-8b9d-61385ab575d4 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.741889 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563159f-23a8-4284-a93a-4612bca22881 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.746955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397039b6-43f4-447d-b10f-f91597fe519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.747851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397039b6-43f4-447d-b10f-f91597fe519f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.748208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397039b6-43f4-447d-b10f-f91597fe519f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.748553 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397039b6-43f4-447d-b10f-f91597fe519f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.757369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-5563159f-23a8-4284-a93a-4612bca22881 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:09.759323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 279/573] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.760399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563159f-23a8-4284-a93a-4612bca22881 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.762134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397039b6-43f4-447d-b10f-f91597fe519f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:09.771196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-397039b6-43f4-447d-b10f-f91597fe519f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:09.772162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563159f-23a8-4284-a93a-4612bca22881 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.773538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 295/574] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.775028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397039b6-43f4-447d-b10f-f91597fe519f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.778359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3158c-0097-4c04-8d13-0d829d2c5913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.779605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3158c-0097-4c04-8d13-0d829d2c5913 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.780058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3158c-0097-4c04-8d13-0d829d2c5913 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.780547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3158c-0097-4c04-8d13-0d829d2c5913 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.781588 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3158c-0097-4c04-8d13-0d829d2c5913 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.782064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3158c-0097-4c04-8d13-0d829d2c5913 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.784154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3158c-0097-4c04-8d13-0d829d2c5913 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.789234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397039b6-43f4-447d-b10f-f91597fe519f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.795462 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633c6ac-6351-42fc-9602-2cec5c588441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.797161 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633c6ac-6351-42fc-9602-2cec5c588441 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.797568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633c6ac-6351-42fc-9602-2cec5c588441 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.797858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633c6ac-6351-42fc-9602-2cec5c588441 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.798702 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633c6ac-6351-42fc-9602-2cec5c588441 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.799092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633c6ac-6351-42fc-9602-2cec5c588441 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.801210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633c6ac-6351-42fc-9602-2cec5c588441 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.807377 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 280/575] 10.222.0.117 () {56 vars in 1163 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:09.808616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3158c-0097-4c04-8d13-0d829d2c5913 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.818223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 296/576] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:09.819932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633c6ac-6351-42fc-9602-2cec5c588441 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.820413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3158c-0097-4c04-8d13-0d829d2c5913 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.825699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab6def-daa4-41c4-9af8-1d2e655ce1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.826923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab6def-daa4-41c4-9af8-1d2e655ce1fc admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.827416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab6def-daa4-41c4-9af8-1d2e655ce1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.827904 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab6def-daa4-41c4-9af8-1d2e655ce1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.828902 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab6def-daa4-41c4-9af8-1d2e655ce1fc admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.829420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab6def-daa4-41c4-9af8-1d2e655ce1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.831154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633c6ac-6351-42fc-9602-2cec5c588441 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.831621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab6def-daa4-41c4-9af8-1d2e655ce1fc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.837618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456e565-fc8d-475e-870b-dabb9c72841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.838491 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e565-fc8d-475e-870b-dabb9c72841c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.838814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e565-fc8d-475e-870b-dabb9c72841c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.839099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e565-fc8d-475e-870b-dabb9c72841c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.844334 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 281/577] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:09.845627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab6def-daa4-41c4-9af8-1d2e655ce1fc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.855232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456e565-fc8d-475e-870b-dabb9c72841c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.856948 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab6def-daa4-41c4-9af8-1d2e655ce1fc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.857077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456e565-fc8d-475e-870b-dabb9c72841c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.863945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1f2e7-ecc0-462d-96a4-b05ae9d8ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.865141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1f2e7-ecc0-462d-96a4-b05ae9d8ca14 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.866057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1f2e7-ecc0-462d-96a4-b05ae9d8ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.866452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1f2e7-ecc0-462d-96a4-b05ae9d8ca14 admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/3c62250938c543d788dd7fd690b5abad/roles/adcc0add18bc4deebfb1e1785ed0297b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.877441 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-4456e565-fc8d-475e-870b-dabb9c72841c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:09.879080 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 297/578] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.880092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456e565-fc8d-475e-870b-dabb9c72841c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.887637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1f2e7-ecc0-462d-96a4-b05ae9d8ca14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=3c62250938c543d788dd7fd690b5abad, role_id=adcc0add18bc4deebfb1e1785ed0297b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.890277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1f2e7-ecc0-462d-96a4-b05ae9d8ca14 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.891526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456e565-fc8d-475e-870b-dabb9c72841c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.896833 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afbe78-e6a9-4a59-b821-ab743131d311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.898319 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afbe78-e6a9-4a59-b821-ab743131d311 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.898653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afbe78-e6a9-4a59-b821-ab743131d311 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.898993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afbe78-e6a9-4a59-b821-ab743131d311 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.906037 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 282/579] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:38:09 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/3c62250938c543d788dd7fd690b5abad/roles/adcc0add18bc4deebfb1e1785ed0297b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:38:09.907092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1f2e7-ecc0-462d-96a4-b05ae9d8ca14 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.911476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afbe78-e6a9-4a59-b821-ab743131d311 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.913961 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afbe78-e6a9-4a59-b821-ab743131d311 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:09.933055 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-90afbe78-e6a9-4a59-b821-ab743131d311 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:09.935416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 298/580] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:09.940909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afbe78-e6a9-4a59-b821-ab743131d311 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:09.954708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afbe78-e6a9-4a59-b821-ab743131d311 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.977921 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1f2e7-ecc0-462d-96a4-b05ae9d8ca14 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:09.983549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240005cb-b758-4ec4-af85-fca05feeb732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:09.984581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240005cb-b758-4ec4-af85-fca05feeb732 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:09.985099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240005cb-b758-4ec4-af85-fca05feeb732 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:09.985539 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240005cb-b758-4ec4-af85-fca05feeb732 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:09.986447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240005cb-b758-4ec4-af85-fca05feeb732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:09.986996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240005cb-b758-4ec4-af85-fca05feeb732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:09.988849 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240005cb-b758-4ec4-af85-fca05feeb732 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.002335 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 283/581] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:10.008569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240005cb-b758-4ec4-af85-fca05feeb732 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.026192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240005cb-b758-4ec4-af85-fca05feeb732 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.028629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df952d5-34d0-4eff-87c5-423eb48c9d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.028629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df952d5-34d0-4eff-87c5-423eb48c9d32 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.028629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df952d5-34d0-4eff-87c5-423eb48c9d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.028629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df952d5-34d0-4eff-87c5-423eb48c9d32 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.029277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df952d5-34d0-4eff-87c5-423eb48c9d32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:10.029659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df952d5-34d0-4eff-87c5-423eb48c9d32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.031482 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df952d5-34d0-4eff-87c5-423eb48c9d32 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.034596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54c039-73c5-45ec-ad79-fba21978bb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.035404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54c039-73c5-45ec-ad79-fba21978bb21 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.035691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54c039-73c5-45ec-ad79-fba21978bb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.035968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54c039-73c5-45ec-ad79-fba21978bb21 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.044459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 299/582] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:10.050998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df952d5-34d0-4eff-87c5-423eb48c9d32 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.058908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54c039-73c5-45ec-ad79-fba21978bb21 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.060920 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54c039-73c5-45ec-ad79-fba21978bb21 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.061453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df952d5-34d0-4eff-87c5-423eb48c9d32 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.076835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd61f9-df87-4ad9-a35e-0387e0b12a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.077785 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd61f9-df87-4ad9-a35e-0387e0b12a73 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.078070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd61f9-df87-4ad9-a35e-0387e0b12a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.078343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd61f9-df87-4ad9-a35e-0387e0b12a73 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.091735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd61f9-df87-4ad9-a35e-0387e0b12a73 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.093086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-cd54c039-73c5-45ec-ad79-fba21978bb21 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:10.093792 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd61f9-df87-4ad9-a35e-0387e0b12a73 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.094545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 284/583] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:10.096170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399b28-27d8-4bfc-832c-697b77271656 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.096457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399b28-27d8-4bfc-832c-697b77271656 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.097356 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399b28-27d8-4bfc-832c-697b77271656 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.099485 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 285/584] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:10.100254 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62399b28-27d8-4bfc-832c-697b77271656 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.113488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-bdcd61f9-df87-4ad9-a35e-0387e0b12a73 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 24 16:38:10.113853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62399b28-27d8-4bfc-832c-697b77271656 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.115110 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 300/585] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:10.116782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947ceee-e007-4206-bff4-d0af93e5dba1 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.117072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947ceee-e007-4206-bff4-d0af93e5dba1 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.117449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947ceee-e007-4206-bff4-d0af93e5dba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.123562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde227-f6a1-497d-b005-7c9dd90d7d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.124491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde227-f6a1-497d-b005-7c9dd90d7d6e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.124773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde227-f6a1-497d-b005-7c9dd90d7d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.125983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde227-f6a1-497d-b005-7c9dd90d7d6e admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.126860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde227-f6a1-497d-b005-7c9dd90d7d6e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:10.127178 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde227-f6a1-497d-b005-7c9dd90d7d6e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.129064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde227-f6a1-497d-b005-7c9dd90d7d6e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.139995 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f947ceee-e007-4206-bff4-d0af93e5dba1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:10.141489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f947ceee-e007-4206-bff4-d0af93e5dba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:10.143674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 286/586] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:10.144646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde227-f6a1-497d-b005-7c9dd90d7d6e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.155446 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde227-f6a1-497d-b005-7c9dd90d7d6e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.155658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 301/587] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:10 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:10.156401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947ceee-e007-4206-bff4-d0af93e5dba1 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.167641 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8a038-9d90-43a3-8015-a86efe0d005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.168317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8a038-9d90-43a3-8015-a86efe0d005e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.168599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8a038-9d90-43a3-8015-a86efe0d005e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.168883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8a038-9d90-43a3-8015-a86efe0d005e admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.169251 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947ceee-e007-4206-bff4-d0af93e5dba1 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.169743 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8a038-9d90-43a3-8015-a86efe0d005e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:10.170049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8a038-9d90-43a3-8015-a86efe0d005e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.172315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8a038-9d90-43a3-8015-a86efe0d005e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.173989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba89b2-5bf6-489e-b699-e79410611c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.176024 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba89b2-5bf6-489e-b699-e79410611c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.176368 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba89b2-5bf6-489e-b699-e79410611c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.176690 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba89b2-5bf6-489e-b699-e79410611c66 admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/2691f7bb4ed84de4bb5901710a96d766/roles/adcc0add18bc4deebfb1e1785ed0297b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.195141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 287/588] 10.222.0.117 () {56 vars in 1165 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:10.196059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8a038-9d90-43a3-8015-a86efe0d005e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.203306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba89b2-5bf6-489e-b699-e79410611c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=2691f7bb4ed84de4bb5901710a96d766, role_id=adcc0add18bc4deebfb1e1785ed0297b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.206042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba89b2-5bf6-489e-b699-e79410611c66 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.207009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8a038-9d90-43a3-8015-a86efe0d005e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.213897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba142d-ea57-4d8e-8e81-4eefbb44d685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.214700 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba142d-ea57-4d8e-8e81-4eefbb44d685 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.215102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba142d-ea57-4d8e-8e81-4eefbb44d685 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.215388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba142d-ea57-4d8e-8e81-4eefbb44d685 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.220167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 302/589] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:38:10 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/2691f7bb4ed84de4bb5901710a96d766/roles/adcc0add18bc4deebfb1e1785ed0297b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:38:10.221117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba89b2-5bf6-489e-b699-e79410611c66 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.228873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba142d-ea57-4d8e-8e81-4eefbb44d685 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:10.236337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-1cba142d-ea57-4d8e-8e81-4eefbb44d685 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:10.238039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 288/590] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:10.247832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba142d-ea57-4d8e-8e81-4eefbb44d685 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.269068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba142d-ea57-4d8e-8e81-4eefbb44d685 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.292823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba89b2-5bf6-489e-b699-e79410611c66 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.297927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118d678-104f-4cd8-9928-f778a1a1f440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.298806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118d678-104f-4cd8-9928-f778a1a1f440 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.299098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118d678-104f-4cd8-9928-f778a1a1f440 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.299376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118d678-104f-4cd8-9928-f778a1a1f440 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.312537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118d678-104f-4cd8-9928-f778a1a1f440 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.314616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118d678-104f-4cd8-9928-f778a1a1f440 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.335809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-c118d678-104f-4cd8-9928-f778a1a1f440 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:10.337645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 303/591] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:10.342906 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118d678-104f-4cd8-9928-f778a1a1f440 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.361751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118d678-104f-4cd8-9928-f778a1a1f440 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.371595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e6f06-ad19-4b7c-85af-4729615a6103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.372622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6f06-ad19-4b7c-85af-4729615a6103 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.372907 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6f06-ad19-4b7c-85af-4729615a6103 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.373959 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6f06-ad19-4b7c-85af-4729615a6103 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.375026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e6f06-ad19-4b7c-85af-4729615a6103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:10.375340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e6f06-ad19-4b7c-85af-4729615a6103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.380124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e6f06-ad19-4b7c-85af-4729615a6103 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.403457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3eb4b8-64f7-481f-908f-79cd74390d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.404245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eb4b8-64f7-481f-908f-79cd74390d69 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.404574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eb4b8-64f7-481f-908f-79cd74390d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.404853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eb4b8-64f7-481f-908f-79cd74390d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.405672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 304/592] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:10.406019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3eb4b8-64f7-481f-908f-79cd74390d69 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:10.406331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3eb4b8-64f7-481f-908f-79cd74390d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.407973 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3eb4b8-64f7-481f-908f-79cd74390d69 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.410015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e6f06-ad19-4b7c-85af-4729615a6103 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.425276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e6f06-ad19-4b7c-85af-4729615a6103 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.428408 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 289/593] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:10.434297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3eb4b8-64f7-481f-908f-79cd74390d69 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.435737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540b41-4a44-406b-b1f1-55ac43dde3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.436526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540b41-4a44-406b-b1f1-55ac43dde3fb admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.436820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540b41-4a44-406b-b1f1-55ac43dde3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.437082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540b41-4a44-406b-b1f1-55ac43dde3fb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.446697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3eb4b8-64f7-481f-908f-79cd74390d69 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.452313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00540b41-4a44-406b-b1f1-55ac43dde3fb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.453567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00540b41-4a44-406b-b1f1-55ac43dde3fb admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.454302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0226b9-617e-4c29-aba1-fff13ba92ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.455481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0226b9-617e-4c29-aba1-fff13ba92ade admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.455966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0226b9-617e-4c29-aba1-fff13ba92ade admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.456486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0226b9-617e-4c29-aba1-fff13ba92ade admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.470191 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0226b9-617e-4c29-aba1-fff13ba92ade admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.472418 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0226b9-617e-4c29-aba1-fff13ba92ade admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.474124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-00540b41-4a44-406b-b1f1-55ac43dde3fb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:10.476475 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 305/594] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:10.482147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540b41-4a44-406b-b1f1-55ac43dde3fb admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.493594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-9c0226b9-617e-4c29-aba1-fff13ba92ade admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:10.495300 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540b41-4a44-406b-b1f1-55ac43dde3fb admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.498950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 290/595] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:10.500920 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0226b9-617e-4c29-aba1-fff13ba92ade admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.501297 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cc6fc-23fd-43c1-8441-cdecb43ba03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.502233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc6fc-23fd-43c1-8441-cdecb43ba03a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.502727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc6fc-23fd-43c1-8441-cdecb43ba03a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.503261 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc6fc-23fd-43c1-8441-cdecb43ba03a admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.504363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cc6fc-23fd-43c1-8441-cdecb43ba03a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:10.504870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cc6fc-23fd-43c1-8441-cdecb43ba03a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.508081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cc6fc-23fd-43c1-8441-cdecb43ba03a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.513502 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0226b9-617e-4c29-aba1-fff13ba92ade admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.521237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 306/596] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:10.521495 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0af5-de8f-4eef-85d5-cec0b3ccf006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.522016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0af5-de8f-4eef-85d5-cec0b3ccf006 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.523406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0af5-de8f-4eef-85d5-cec0b3ccf006 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.523406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0af5-de8f-4eef-85d5-cec0b3ccf006 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.523406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0af5-de8f-4eef-85d5-cec0b3ccf006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:10.523735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0af5-de8f-4eef-85d5-cec0b3ccf006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.525293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0af5-de8f-4eef-85d5-cec0b3ccf006 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.532795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cc6fc-23fd-43c1-8441-cdecb43ba03a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.546868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 291/597] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:10.547120 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cc6fc-23fd-43c1-8441-cdecb43ba03a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.552673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0af5-de8f-4eef-85d5-cec0b3ccf006 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.560714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df1485-077c-49f2-8185-d666df6d44d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.561252 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1485-077c-49f2-8185-d666df6d44d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.561579 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1485-077c-49f2-8185-d666df6d44d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.561860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1485-077c-49f2-8185-d666df6d44d5 admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/aa9834b75e2b4ac787f3917564090d2d/roles/adcc0add18bc4deebfb1e1785ed0297b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.565176 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0af5-de8f-4eef-85d5-cec0b3ccf006 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.570592 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767ed65-4015-4a4c-8113-bce45746aba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.572572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767ed65-4015-4a4c-8113-bce45746aba9 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.573082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767ed65-4015-4a4c-8113-bce45746aba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.573556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767ed65-4015-4a4c-8113-bce45746aba9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.581957 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767ed65-4015-4a4c-8113-bce45746aba9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.584548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767ed65-4015-4a4c-8113-bce45746aba9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.594366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df1485-077c-49f2-8185-d666df6d44d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=aa9834b75e2b4ac787f3917564090d2d, role_id=adcc0add18bc4deebfb1e1785ed0297b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.597166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df1485-077c-49f2-8185-d666df6d44d5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.600410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-3767ed65-4015-4a4c-8113-bce45746aba9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 24 16:38:10.603632 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 292/598] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:10.609726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767ed65-4015-4a4c-8113-bce45746aba9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.626795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 307/599] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:38:10 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/aa9834b75e2b4ac787f3917564090d2d/roles/adcc0add18bc4deebfb1e1785ed0297b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:38:10.626981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767ed65-4015-4a4c-8113-bce45746aba9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.703635 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01feeed0-e14b-46be-98e4-75e4faf397cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.704383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feeed0-e14b-46be-98e4-75e4faf397cb admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.704665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feeed0-e14b-46be-98e4-75e4faf397cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.704941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feeed0-e14b-46be-98e4-75e4faf397cb admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.705852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01feeed0-e14b-46be-98e4-75e4faf397cb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:10.706165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01feeed0-e14b-46be-98e4-75e4faf397cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.709289 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01feeed0-e14b-46be-98e4-75e4faf397cb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.736193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 293/600] 10.222.0.117 () {56 vars in 1161 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:10.743130 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df1485-077c-49f2-8185-d666df6d44d5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.755374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df1485-077c-49f2-8185-d666df6d44d5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.761150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be51cf-8078-44fd-8873-b07c21a58a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.761864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be51cf-8078-44fd-8873-b07c21a58a71 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.762241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be51cf-8078-44fd-8873-b07c21a58a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.762521 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be51cf-8078-44fd-8873-b07c21a58a71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.771860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be51cf-8078-44fd-8873-b07c21a58a71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.774180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be51cf-8078-44fd-8873-b07c21a58a71 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.792254 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 308/601] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:38:10.797918 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01feeed0-e14b-46be-98e4-75e4faf397cb admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.811170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01feeed0-e14b-46be-98e4-75e4faf397cb admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.820433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f446-decb-417b-bb65-42933ffdf7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.821240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f446-decb-417b-bb65-42933ffdf7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.821525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f446-decb-417b-bb65-42933ffdf7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.821800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f446-decb-417b-bb65-42933ffdf7b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.834209 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f446-decb-417b-bb65-42933ffdf7b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.837351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f446-decb-417b-bb65-42933ffdf7b7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.856308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-eb65f446-decb-417b-bb65-42933ffdf7b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:10.858015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 294/602] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:10.862966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be51cf-8078-44fd-8873-b07c21a58a71 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.872508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be51cf-8078-44fd-8873-b07c21a58a71 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.877064 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ec6e4-95f3-4f76-a14f-78a8560ee509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.877704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec6e4-95f3-4f76-a14f-78a8560ee509 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.878169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec6e4-95f3-4f76-a14f-78a8560ee509 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.878495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec6e4-95f3-4f76-a14f-78a8560ee509 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.879263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ec6e4-95f3-4f76-a14f-78a8560ee509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:10.879617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ec6e4-95f3-4f76-a14f-78a8560ee509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.881184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ec6e4-95f3-4f76-a14f-78a8560ee509 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.896394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 309/603] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:10.902181 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f446-decb-417b-bb65-42933ffdf7b7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.912347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f446-decb-417b-bb65-42933ffdf7b7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.917930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb291e2-490f-4fcf-ad4a-632baf759cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.918835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb291e2-490f-4fcf-ad4a-632baf759cbc admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.919135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb291e2-490f-4fcf-ad4a-632baf759cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.919413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb291e2-490f-4fcf-ad4a-632baf759cbc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.927000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb291e2-490f-4fcf-ad4a-632baf759cbc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.929753 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb291e2-490f-4fcf-ad4a-632baf759cbc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.943657 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-ccb291e2-490f-4fcf-ad4a-632baf759cbc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:10.945951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 295/604] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:10.951113 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ec6e4-95f3-4f76-a14f-78a8560ee509 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:10.961533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ec6e4-95f3-4f76-a14f-78a8560ee509 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:10.966480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55154920-c138-4bce-b10c-1e974078c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:10.967372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55154920-c138-4bce-b10c-1e974078c780 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:10.967756 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55154920-c138-4bce-b10c-1e974078c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:10.968130 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55154920-c138-4bce-b10c-1e974078c780 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:10.969131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55154920-c138-4bce-b10c-1e974078c780 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:10.969606 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55154920-c138-4bce-b10c-1e974078c780 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:10.971615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55154920-c138-4bce-b10c-1e974078c780 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:10.986036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 310/605] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:10.992603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb291e2-490f-4fcf-ad4a-632baf759cbc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:11.009193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb291e2-490f-4fcf-ad4a-632baf759cbc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:11.013873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb558ba-cb4a-48fa-807b-2fa02be83488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:11.014676 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb558ba-cb4a-48fa-807b-2fa02be83488 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:11.015120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb558ba-cb4a-48fa-807b-2fa02be83488 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:11.015556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb558ba-cb4a-48fa-807b-2fa02be83488 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:11.016542 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb558ba-cb4a-48fa-807b-2fa02be83488 admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=6a6d64d2408e481db883823e98f4d831) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:11.016996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb558ba-cb4a-48fa-807b-2fa02be83488 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:11.018998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb558ba-cb4a-48fa-807b-2fa02be83488 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:11.025191 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 296/606] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:10 2022] GET /identity/v3/role_assignments?user.id=6a6d64d2408e481db883823e98f4d831&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:12.622992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41460f-07de-4f20-8220-3b2c260cdb0a None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.623667 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41460f-07de-4f20-8220-3b2c260cdb0a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.623667 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41460f-07de-4f20-8220-3b2c260cdb0a None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.626533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 311/607] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:12 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:12.632489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3e03a-ba4b-49f1-b7eb-40d08090fbd1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.633045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3e03a-ba4b-49f1-b7eb-40d08090fbd1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.633045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3e03a-ba4b-49f1-b7eb-40d08090fbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.660022 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-80e3e03a-ba4b-49f1-b7eb-40d08090fbd1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:12.661234 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-80e3e03a-ba4b-49f1-b7eb-40d08090fbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:12.669840 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 297/608] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:12 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:12.680347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d309f-ad31-459e-9792-6ac918138a01 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.680677 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d309f-ad31-459e-9792-6ac918138a01 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.680903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d309f-ad31-459e-9792-6ac918138a01 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.683078 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 312/609] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:12.688857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3216e-8243-4aa7-95f0-6c9403bda03f None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.689147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3216e-8243-4aa7-95f0-6c9403bda03f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.689424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3216e-8243-4aa7-95f0-6c9403bda03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.703203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d309f-ad31-459e-9792-6ac918138a01 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:12.715280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d309f-ad31-459e-9792-6ac918138a01 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:12.719736 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453e5b-2ffe-42ed-990d-9b3ce232034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:12.719873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b3d3216e-8243-4aa7-95f0-6c9403bda03f None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:12.720702 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453e5b-2ffe-42ed-990d-9b3ce232034f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.721002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b3d3216e-8243-4aa7-95f0-6c9403bda03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:12.721123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453e5b-2ffe-42ed-990d-9b3ce232034f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.721514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453e5b-2ffe-42ed-990d-9b3ce232034f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.732411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13453e5b-2ffe-42ed-990d-9b3ce232034f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:12.738459 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 298/610] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:12 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:12.739878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-13453e5b-2ffe-42ed-990d-9b3ce232034f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:12.741778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 313/611] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:12.747417 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3216e-8243-4aa7-95f0-6c9403bda03f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:12.757453 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3216e-8243-4aa7-95f0-6c9403bda03f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:12.762133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668df347-e0ee-4e7a-b278-2ae2fa04c9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:12.762821 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668df347-e0ee-4e7a-b278-2ae2fa04c9cf admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.763089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668df347-e0ee-4e7a-b278-2ae2fa04c9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.763427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668df347-e0ee-4e7a-b278-2ae2fa04c9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.764193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668df347-e0ee-4e7a-b278-2ae2fa04c9cf admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:12.764498 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668df347-e0ee-4e7a-b278-2ae2fa04c9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:12.766092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668df347-e0ee-4e7a-b278-2ae2fa04c9cf admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:12.774953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 299/612] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:12 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:12.779634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453e5b-2ffe-42ed-990d-9b3ce232034f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:12.786904 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668df347-e0ee-4e7a-b278-2ae2fa04c9cf admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:12.795788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453e5b-2ffe-42ed-990d-9b3ce232034f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:12.802352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f9156-7049-4cd9-bc8e-7af90ae0a85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:12.803160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f9156-7049-4cd9-bc8e-7af90ae0a85c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.803476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f9156-7049-4cd9-bc8e-7af90ae0a85c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.804358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f9156-7049-4cd9-bc8e-7af90ae0a85c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.806961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668df347-e0ee-4e7a-b278-2ae2fa04c9cf admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:12.818116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5157-84c0-4f19-8f6b-9e0af7d9f724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:12.818920 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5157-84c0-4f19-8f6b-9e0af7d9f724 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.819388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5157-84c0-4f19-8f6b-9e0af7d9f724 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.819909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5157-84c0-4f19-8f6b-9e0af7d9f724 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.827446 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f9156-7049-4cd9-bc8e-7af90ae0a85c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:12.834353 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-8d0f9156-7049-4cd9-bc8e-7af90ae0a85c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:12.835756 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 314/613] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:12.841029 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a5157-84c0-4f19-8f6b-9e0af7d9f724 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:12.842894 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a5157-84c0-4f19-8f6b-9e0af7d9f724 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:12.844135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f9156-7049-4cd9-bc8e-7af90ae0a85c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:12.860888 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f9156-7049-4cd9-bc8e-7af90ae0a85c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:12.870891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-c51a5157-84c0-4f19-8f6b-9e0af7d9f724 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:12.872079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 300/614] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:12.879700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb732fea-72b8-42bd-87bb-6f8ad9e900a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:12.880296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732fea-72b8-42bd-87bb-6f8ad9e900a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.880577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732fea-72b8-42bd-87bb-6f8ad9e900a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.880850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732fea-72b8-42bd-87bb-6f8ad9e900a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.881700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb732fea-72b8-42bd-87bb-6f8ad9e900a7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:12.882052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb732fea-72b8-42bd-87bb-6f8ad9e900a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:12.883662 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb732fea-72b8-42bd-87bb-6f8ad9e900a7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:12.885738 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5157-84c0-4f19-8f6b-9e0af7d9f724 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:12.896558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5157-84c0-4f19-8f6b-9e0af7d9f724 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:12.901423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb4416-62ec-423a-836a-ceaf60eeb4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:12.902527 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 315/615] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:12 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:12.902785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4416-62ec-423a-836a-ceaf60eeb4af admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.903287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4416-62ec-423a-836a-ceaf60eeb4af admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.903773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4416-62ec-423a-836a-ceaf60eeb4af admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.904708 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb4416-62ec-423a-836a-ceaf60eeb4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:12.905236 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb4416-62ec-423a-836a-ceaf60eeb4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:12.907049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb4416-62ec-423a-836a-ceaf60eeb4af admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:12.907789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb732fea-72b8-42bd-87bb-6f8ad9e900a7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:12.920892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb732fea-72b8-42bd-87bb-6f8ad9e900a7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:12.921193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 301/616] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:12.927074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb4416-62ec-423a-836a-ceaf60eeb4af admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:12.936751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266109-d5b7-4d8e-85f7-b8c7e2035fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:12.937870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266109-d5b7-4d8e-85f7-b8c7e2035fcd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.938378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266109-d5b7-4d8e-85f7-b8c7e2035fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.938914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266109-d5b7-4d8e-85f7-b8c7e2035fcd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.947486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb4416-62ec-423a-836a-ceaf60eeb4af admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:12.952428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cb10f-582e-4466-80a2-801a28f62dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:12.953523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cb10f-582e-4466-80a2-801a28f62dcb admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:12.954036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cb10f-582e-4466-80a2-801a28f62dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:12.954506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cb10f-582e-4466-80a2-801a28f62dcb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:12.963130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cb10f-582e-4466-80a2-801a28f62dcb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:12.964175 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90266109-d5b7-4d8e-85f7-b8c7e2035fcd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:12.965733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cb10f-582e-4466-80a2-801a28f62dcb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:12.966000 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90266109-d5b7-4d8e-85f7-b8c7e2035fcd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:12.981871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-6e6cb10f-582e-4466-80a2-801a28f62dcb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 24 16:38:12.983795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 302/617] 10.222.0.117 () {56 vars in 1119 bytes} [Mon Jan 24 16:38:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:12.989416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cb10f-582e-4466-80a2-801a28f62dcb admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.000793 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cb10f-582e-4466-80a2-801a28f62dcb admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.004532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-90266109-d5b7-4d8e-85f7-b8c7e2035fcd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:13.006005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab460b7-65ee-4dc8-869b-a4994904d79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.006208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 316/618] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:13.007630 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab460b7-65ee-4dc8-869b-a4994904d79e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.008309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab460b7-65ee-4dc8-869b-a4994904d79e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.008803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab460b7-65ee-4dc8-869b-a4994904d79e admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.009858 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab460b7-65ee-4dc8-869b-a4994904d79e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.010364 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab460b7-65ee-4dc8-869b-a4994904d79e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.012229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266109-d5b7-4d8e-85f7-b8c7e2035fcd admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.012865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab460b7-65ee-4dc8-869b-a4994904d79e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.028606 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266109-d5b7-4d8e-85f7-b8c7e2035fcd admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.034374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 303/619] 10.222.0.117 () {56 vars in 1159 bytes} [Mon Jan 24 16:38:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.040012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab460b7-65ee-4dc8-869b-a4994904d79e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.050421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab460b7-65ee-4dc8-869b-a4994904d79e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.051436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943668-23d5-4f61-85af-aed43b45bcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.052103 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943668-23d5-4f61-85af-aed43b45bcca admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.052382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943668-23d5-4f61-85af-aed43b45bcca admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.052653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943668-23d5-4f61-85af-aed43b45bcca admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.053391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9943668-23d5-4f61-85af-aed43b45bcca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.053839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9943668-23d5-4f61-85af-aed43b45bcca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.055568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9943668-23d5-4f61-85af-aed43b45bcca admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.056757 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16744803-9c5a-496d-8e5e-04a2684c6c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.057616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16744803-9c5a-496d-8e5e-04a2684c6c59 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.058173 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16744803-9c5a-496d-8e5e-04a2684c6c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.058645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16744803-9c5a-496d-8e5e-04a2684c6c59 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.067125 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16744803-9c5a-496d-8e5e-04a2684c6c59 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.069701 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16744803-9c5a-496d-8e5e-04a2684c6c59 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.076872 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 317/620] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.080014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 304/621] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:38:13.084637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943668-23d5-4f61-85af-aed43b45bcca admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.086600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16744803-9c5a-496d-8e5e-04a2684c6c59 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.102986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943668-23d5-4f61-85af-aed43b45bcca admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.106338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16744803-9c5a-496d-8e5e-04a2684c6c59 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.113048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c4466-78f8-425c-be81-f61ccaa5fc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.114685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c4466-78f8-425c-be81-f61ccaa5fc6c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.114989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c4466-78f8-425c-be81-f61ccaa5fc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.115265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c4466-78f8-425c-be81-f61ccaa5fc6c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.116577 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b626d93-9de4-428a-9e8c-7240fabb47e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.117506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626d93-9de4-428a-9e8c-7240fabb47e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.117782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626d93-9de4-428a-9e8c-7240fabb47e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.118050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626d93-9de4-428a-9e8c-7240fabb47e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.132731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c4466-78f8-425c-be81-f61ccaa5fc6c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.136072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c4466-78f8-425c-be81-f61ccaa5fc6c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.148443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b626d93-9de4-428a-9e8c-7240fabb47e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.150279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b626d93-9de4-428a-9e8c-7240fabb47e8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.162358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-5f7c4466-78f8-425c-be81-f61ccaa5fc6c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 24 16:38:13.174828 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 318/622] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:13.176118 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c4466-78f8-425c-be81-f61ccaa5fc6c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.177572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-3b626d93-9de4-428a-9e8c-7240fabb47e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:13.179663 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 305/623] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:13.187709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b626d93-9de4-428a-9e8c-7240fabb47e8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.188408 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c4466-78f8-425c-be81-f61ccaa5fc6c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.199962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf8868-b8de-4afe-be7d-8a6b8363efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.200615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf8868-b8de-4afe-be7d-8a6b8363efc1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.200890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf8868-b8de-4afe-be7d-8a6b8363efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.201160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf8868-b8de-4afe-be7d-8a6b8363efc1 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.201994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf8868-b8de-4afe-be7d-8a6b8363efc1 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.202299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf8868-b8de-4afe-be7d-8a6b8363efc1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.204147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf8868-b8de-4afe-be7d-8a6b8363efc1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.204970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b626d93-9de4-428a-9e8c-7240fabb47e8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.222563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 319/624] 10.222.0.117 () {56 vars in 1163 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:13.223349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50598f2d-bead-4cef-8d49-ff14edc4c93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.224025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598f2d-bead-4cef-8d49-ff14edc4c93e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.224312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598f2d-bead-4cef-8d49-ff14edc4c93e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.224593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598f2d-bead-4cef-8d49-ff14edc4c93e admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.225381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50598f2d-bead-4cef-8d49-ff14edc4c93e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.225694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50598f2d-bead-4cef-8d49-ff14edc4c93e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.227913 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50598f2d-bead-4cef-8d49-ff14edc4c93e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.232007 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf8868-b8de-4afe-be7d-8a6b8363efc1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.242422 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf8868-b8de-4afe-be7d-8a6b8363efc1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.246095 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 306/625] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.250772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d47862-3c25-4ae9-b2be-8cc21a2b4883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.251984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50598f2d-bead-4cef-8d49-ff14edc4c93e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.252947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47862-3c25-4ae9-b2be-8cc21a2b4883 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.253229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47862-3c25-4ae9-b2be-8cc21a2b4883 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.253501 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47862-3c25-4ae9-b2be-8cc21a2b4883 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.270979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50598f2d-bead-4cef-8d49-ff14edc4c93e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.272356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d47862-3c25-4ae9-b2be-8cc21a2b4883 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.274105 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d47862-3c25-4ae9-b2be-8cc21a2b4883 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.282212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56deba-feb3-4d01-bf56-fef1ff7aeb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.283576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56deba-feb3-4d01-bf56-fef1ff7aeb99 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.283857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56deba-feb3-4d01-bf56-fef1ff7aeb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.284132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56deba-feb3-4d01-bf56-fef1ff7aeb99 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.287147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 320/626] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:38:13.288447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4d3f-01d6-4faf-8411-c0fadb87d6e2 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.288894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4d3f-01d6-4faf-8411-c0fadb87d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.289173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4d3f-01d6-4faf-8411-c0fadb87d6e2 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.291095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 321/627] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:13.293010 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b4d3f-01d6-4faf-8411-c0fadb87d6e2 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.296325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56deba-feb3-4d01-bf56-fef1ff7aeb99 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.298460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56deba-feb3-4d01-bf56-fef1ff7aeb99 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.306689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b4d3f-01d6-4faf-8411-c0fadb87d6e2 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.311397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b453ec-0029-40bf-a8a2-a16416164f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.312392 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b453ec-0029-40bf-a8a2-a16416164f7c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.312863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b453ec-0029-40bf-a8a2-a16416164f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.313320 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b453ec-0029-40bf-a8a2-a16416164f7c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.313965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-7a56deba-feb3-4d01-bf56-fef1ff7aeb99 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:13.315737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 307/628] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:13.317053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d2d3b-6f3c-4ee2-9398-4cb069c586a6 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.317341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d2d3b-6f3c-4ee2-9398-4cb069c586a6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.317619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d2d3b-6f3c-4ee2-9398-4cb069c586a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.326455 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b453ec-0029-40bf-a8a2-a16416164f7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.328610 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b453ec-0029-40bf-a8a2-a16416164f7c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.339741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a62d2d3b-6f3c-4ee2-9398-4cb069c586a6 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:13.340975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a62d2d3b-6f3c-4ee2-9398-4cb069c586a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:13.346985 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-37b453ec-0029-40bf-a8a2-a16416164f7c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:13.348548 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 322/629] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:13.349468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b453ec-0029-40bf-a8a2-a16416164f7c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.349955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 308/630] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:13 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:13.359518 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b453ec-0029-40bf-a8a2-a16416164f7c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.359770 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d2d3b-6f3c-4ee2-9398-4cb069c586a6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.364342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea822a-eccb-457a-9900-fe36e5dfc89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.365079 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea822a-eccb-457a-9900-fe36e5dfc89a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.365458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea822a-eccb-457a-9900-fe36e5dfc89a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.365835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea822a-eccb-457a-9900-fe36e5dfc89a admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.367306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea822a-eccb-457a-9900-fe36e5dfc89a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.367708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea822a-eccb-457a-9900-fe36e5dfc89a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.369644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea822a-eccb-457a-9900-fe36e5dfc89a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.372165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d2d3b-6f3c-4ee2-9398-4cb069c586a6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.377257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb65c4-9b2c-4417-8b70-1cda55666474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.378114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb65c4-9b2c-4417-8b70-1cda55666474 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.378400 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb65c4-9b2c-4417-8b70-1cda55666474 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.378676 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb65c4-9b2c-4417-8b70-1cda55666474 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.379448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb65c4-9b2c-4417-8b70-1cda55666474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.379755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb65c4-9b2c-4417-8b70-1cda55666474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.381337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb65c4-9b2c-4417-8b70-1cda55666474 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.382605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 323/631] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.383779 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ed69-777b-40f0-9bdc-45d562512643 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.384010 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ed69-777b-40f0-9bdc-45d562512643 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.384279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ed69-777b-40f0-9bdc-45d562512643 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.385999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 324/632] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:13.390027 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ed69-777b-40f0-9bdc-45d562512643 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.394979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 309/633] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.396053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb65c4-9b2c-4417-8b70-1cda55666474 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.402727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ed69-777b-40f0-9bdc-45d562512643 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.407066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42f11d-f585-4f23-be85-e8f7b931de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.407826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42f11d-f585-4f23-be85-e8f7b931de0d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.408102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42f11d-f585-4f23-be85-e8f7b931de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.408369 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42f11d-f585-4f23-be85-e8f7b931de0d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.409104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb65c4-9b2c-4417-8b70-1cda55666474 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.413688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d21c5-7f33-491b-a024-b66f39e3290a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.414534 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d21c5-7f33-491b-a024-b66f39e3290a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.414962 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d21c5-7f33-491b-a024-b66f39e3290a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.415332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d21c5-7f33-491b-a024-b66f39e3290a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.416378 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d21c5-7f33-491b-a024-b66f39e3290a admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=37c91fefe89a45b48df82a311e771ea3) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.416910 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d21c5-7f33-491b-a024-b66f39e3290a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.418917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d21c5-7f33-491b-a024-b66f39e3290a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.419686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42f11d-f585-4f23-be85-e8f7b931de0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:13.429616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 310/634] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/role_assignments?user.id=37c91fefe89a45b48df82a311e771ea3&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 610 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.429616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccbb40-63b7-46b3-8506-14a311e61312 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.429616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccbb40-63b7-46b3-8506-14a311e61312 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.429616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccbb40-63b7-46b3-8506-14a311e61312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.429960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-9f42f11d-f585-4f23-be85-e8f7b931de0d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:13.429960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 325/635] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:13.429960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42f11d-f585-4f23-be85-e8f7b931de0d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.439813 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42f11d-f585-4f23-be85-e8f7b931de0d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.447747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a3303-c1b9-4e5e-8885-19f6999eb00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.448648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a3303-c1b9-4e5e-8885-19f6999eb00f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.448998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a3303-c1b9-4e5e-8885-19f6999eb00f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.449338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a3303-c1b9-4e5e-8885-19f6999eb00f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.453423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-52ccbb40-63b7-46b3-8506-14a311e61312 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:13.455031 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-52ccbb40-63b7-46b3-8506-14a311e61312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:13.457345 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a3303-c1b9-4e5e-8885-19f6999eb00f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.459852 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a3303-c1b9-4e5e-8885-19f6999eb00f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.464311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 311/636] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:13 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:13.472026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccbb40-63b7-46b3-8506-14a311e61312 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.475550 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-7f8a3303-c1b9-4e5e-8885-19f6999eb00f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:13.477520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 326/637] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:13.483919 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a3303-c1b9-4e5e-8885-19f6999eb00f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.485569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccbb40-63b7-46b3-8506-14a311e61312 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.497625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78121c-6fb6-4dbb-8366-30bc325a94a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.498313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78121c-6fb6-4dbb-8366-30bc325a94a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.498596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78121c-6fb6-4dbb-8366-30bc325a94a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.498898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78121c-6fb6-4dbb-8366-30bc325a94a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.499685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78121c-6fb6-4dbb-8366-30bc325a94a0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.499994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78121c-6fb6-4dbb-8366-30bc325a94a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.501687 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78121c-6fb6-4dbb-8366-30bc325a94a0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.507151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a3303-c1b9-4e5e-8885-19f6999eb00f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.512385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 312/638] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.512739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4c07d-0c3e-4811-b34e-6b4b6da11d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.513630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4c07d-0c3e-4811-b34e-6b4b6da11d6b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.514153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4c07d-0c3e-4811-b34e-6b4b6da11d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.514643 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4c07d-0c3e-4811-b34e-6b4b6da11d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.515722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4c07d-0c3e-4811-b34e-6b4b6da11d6b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.516257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4c07d-0c3e-4811-b34e-6b4b6da11d6b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.517424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78121c-6fb6-4dbb-8366-30bc325a94a0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.518812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4c07d-0c3e-4811-b34e-6b4b6da11d6b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.529965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78121c-6fb6-4dbb-8366-30bc325a94a0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.532917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 327/639] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.534223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4c07d-0c3e-4811-b34e-6b4b6da11d6b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.536932 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea91d97-fe77-42d5-b3b4-39c3cc305394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.538690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea91d97-fe77-42d5-b3b4-39c3cc305394 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.539086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea91d97-fe77-42d5-b3b4-39c3cc305394 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.539416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea91d97-fe77-42d5-b3b4-39c3cc305394 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.546183 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4c07d-0c3e-4811-b34e-6b4b6da11d6b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.551427 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a226e31-a3b3-46ae-9993-f498e4ac3fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.552654 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226e31-a3b3-46ae-9993-f498e4ac3fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.552963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea91d97-fe77-42d5-b3b4-39c3cc305394 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:13.553460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226e31-a3b3-46ae-9993-f498e4ac3fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.554575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226e31-a3b3-46ae-9993-f498e4ac3fc1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.561464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-aea91d97-fe77-42d5-b3b4-39c3cc305394 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:13.562705 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 313/640] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:13.567591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea91d97-fe77-42d5-b3b4-39c3cc305394 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.575424 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a226e31-a3b3-46ae-9993-f498e4ac3fc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.577597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a226e31-a3b3-46ae-9993-f498e4ac3fc1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.581245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea91d97-fe77-42d5-b3b4-39c3cc305394 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.587495 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd744a4-c890-47f8-9653-fcdd5f34474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.588166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd744a4-c890-47f8-9653-fcdd5f34474c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.588451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd744a4-c890-47f8-9653-fcdd5f34474c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.588723 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd744a4-c890-47f8-9653-fcdd5f34474c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.589893 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd744a4-c890-47f8-9653-fcdd5f34474c admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=3c62250938c543d788dd7fd690b5abad) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.590211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd744a4-c890-47f8-9653-fcdd5f34474c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.592136 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd744a4-c890-47f8-9653-fcdd5f34474c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.597740 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-5a226e31-a3b3-46ae-9993-f498e4ac3fc1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:13.598968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 314/641] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/role_assignments?user.id=3c62250938c543d788dd7fd690b5abad&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 610 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.599529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 328/642] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:13.599818 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd744a4-c890-47f8-9653-fcdd5f34474c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.606207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a226e31-a3b3-46ae-9993-f498e4ac3fc1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.616868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd744a4-c890-47f8-9653-fcdd5f34474c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.617600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a226e31-a3b3-46ae-9993-f498e4ac3fc1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.622544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152fb4b-968d-4650-825b-77df931e06c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.622860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2d294-9bd2-4272-8f99-5986c7120d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.623276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152fb4b-968d-4650-825b-77df931e06c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.623542 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152fb4b-968d-4650-825b-77df931e06c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.623817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152fb4b-968d-4650-825b-77df931e06c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.624405 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2d294-9bd2-4272-8f99-5986c7120d44 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.624856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152fb4b-968d-4650-825b-77df931e06c6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.624928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152fb4b-968d-4650-825b-77df931e06c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.625408 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2d294-9bd2-4272-8f99-5986c7120d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.625887 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2d294-9bd2-4272-8f99-5986c7120d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.626489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152fb4b-968d-4650-825b-77df931e06c6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.627157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2d294-9bd2-4272-8f99-5986c7120d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.627653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2d294-9bd2-4272-8f99-5986c7120d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.629547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2d294-9bd2-4272-8f99-5986c7120d44 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.637142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 315/643] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.642576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152fb4b-968d-4650-825b-77df931e06c6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.654174 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 329/644] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:13.657534 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152fb4b-968d-4650-825b-77df931e06c6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.661884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2d294-9bd2-4272-8f99-5986c7120d44 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.662405 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db671d-474b-443e-ad18-df5363110fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.664778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db671d-474b-443e-ad18-df5363110fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.664778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db671d-474b-443e-ad18-df5363110fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.664778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db671d-474b-443e-ad18-df5363110fe4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.676478 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2d294-9bd2-4272-8f99-5986c7120d44 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.678235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db671d-474b-443e-ad18-df5363110fe4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.680460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db671d-474b-443e-ad18-df5363110fe4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.682550 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d16339-7423-48e2-ae97-a71bde951f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.683856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d16339-7423-48e2-ae97-a71bde951f6e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.684313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d16339-7423-48e2-ae97-a71bde951f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.685157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d16339-7423-48e2-ae97-a71bde951f6e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.695752 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d16339-7423-48e2-ae97-a71bde951f6e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.698212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d16339-7423-48e2-ae97-a71bde951f6e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.702548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-99db671d-474b-443e-ad18-df5363110fe4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:13.704414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 316/645] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:13.714258 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db671d-474b-443e-ad18-df5363110fe4 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.722617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-14d16339-7423-48e2-ae97-a71bde951f6e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 24 16:38:13.725202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 330/646] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:13.729421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db671d-474b-443e-ad18-df5363110fe4 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.731634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d16339-7423-48e2-ae97-a71bde951f6e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.734801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0158278-8e2b-4125-b666-631e1a62339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.735658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158278-8e2b-4125-b666-631e1a62339b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.736030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158278-8e2b-4125-b666-631e1a62339b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.736454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158278-8e2b-4125-b666-631e1a62339b admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.737298 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0158278-8e2b-4125-b666-631e1a62339b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.737750 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0158278-8e2b-4125-b666-631e1a62339b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.739862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0158278-8e2b-4125-b666-631e1a62339b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.744836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d16339-7423-48e2-ae97-a71bde951f6e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.749596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a7d36-e948-4a19-8be8-2b742182da3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.750450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7d36-e948-4a19-8be8-2b742182da3e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.750935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7d36-e948-4a19-8be8-2b742182da3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.751344 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7d36-e948-4a19-8be8-2b742182da3e admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.752352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a7d36-e948-4a19-8be8-2b742182da3e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.752801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a7d36-e948-4a19-8be8-2b742182da3e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.753913 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 317/647] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.755087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a7d36-e948-4a19-8be8-2b742182da3e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.761445 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0158278-8e2b-4125-b666-631e1a62339b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.772079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0158278-8e2b-4125-b666-631e1a62339b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.777955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0eec34-ec55-466a-9273-8a2c247e8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.779032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eec34-ec55-466a-9273-8a2c247e8c3b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.779213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 331/648] 10.222.0.117 () {56 vars in 1163 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:13.782860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eec34-ec55-466a-9273-8a2c247e8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.782860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eec34-ec55-466a-9273-8a2c247e8c3b admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.784862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a7d36-e948-4a19-8be8-2b742182da3e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.792697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0eec34-ec55-466a-9273-8a2c247e8c3b admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.795404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0eec34-ec55-466a-9273-8a2c247e8c3b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.795879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a7d36-e948-4a19-8be8-2b742182da3e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.800924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad508aa-c60d-4bac-879d-ee51759f0c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.801563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad508aa-c60d-4bac-879d-ee51759f0c10 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.801849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad508aa-c60d-4bac-879d-ee51759f0c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.802123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad508aa-c60d-4bac-879d-ee51759f0c10 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.811018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad508aa-c60d-4bac-879d-ee51759f0c10 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.812773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad508aa-c60d-4bac-879d-ee51759f0c10 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.813247 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-5c0eec34-ec55-466a-9273-8a2c247e8c3b admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 24 16:38:13.819726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 318/649] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:13.820953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0eec34-ec55-466a-9273-8a2c247e8c3b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.831015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 332/650] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:38:13.836593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0eec34-ec55-466a-9273-8a2c247e8c3b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.837223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad508aa-c60d-4bac-879d-ee51759f0c10 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.844351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce5483-7ee8-46c5-9354-7a1d6e68b131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.844535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce5483-7ee8-46c5-9354-7a1d6e68b131 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.844719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce5483-7ee8-46c5-9354-7a1d6e68b131 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.845001 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce5483-7ee8-46c5-9354-7a1d6e68b131 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.845862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce5483-7ee8-46c5-9354-7a1d6e68b131 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.846174 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce5483-7ee8-46c5-9354-7a1d6e68b131 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.848407 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce5483-7ee8-46c5-9354-7a1d6e68b131 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.849364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad508aa-c60d-4bac-879d-ee51759f0c10 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.856063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8f615-8724-4873-89ba-082aa3b34e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.856920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8f615-8724-4873-89ba-082aa3b34e73 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.857265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8f615-8724-4873-89ba-082aa3b34e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.857664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8f615-8724-4873-89ba-082aa3b34e73 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.869009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 319/651] 10.222.0.117 () {56 vars in 1165 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.873755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8f615-8724-4873-89ba-082aa3b34e73 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.874514 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce5483-7ee8-46c5-9354-7a1d6e68b131 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.875900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8f615-8724-4873-89ba-082aa3b34e73 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.884999 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce5483-7ee8-46c5-9354-7a1d6e68b131 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.889679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7027f5-5e46-4004-a219-aa8151185720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.890343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7027f5-5e46-4004-a219-aa8151185720 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.890701 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7027f5-5e46-4004-a219-aa8151185720 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.891076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7027f5-5e46-4004-a219-aa8151185720 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.895168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-dce8f615-8724-4873-89ba-082aa3b34e73 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:13.896688 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 333/652] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:13.902899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8f615-8724-4873-89ba-082aa3b34e73 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.903385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7027f5-5e46-4004-a219-aa8151185720 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.905280 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7027f5-5e46-4004-a219-aa8151185720 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.914299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8f615-8724-4873-89ba-082aa3b34e73 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.919500 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa76ba0-b5a7-4719-af4a-b04f3a636089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.919716 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 320/653] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:38:13.920304 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa76ba0-b5a7-4719-af4a-b04f3a636089 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.920588 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa76ba0-b5a7-4719-af4a-b04f3a636089 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.920939 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa76ba0-b5a7-4719-af4a-b04f3a636089 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.921817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa76ba0-b5a7-4719-af4a-b04f3a636089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:13.922090 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa76ba0-b5a7-4719-af4a-b04f3a636089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.923254 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8c7e3-112f-455b-b0b5-612319e1834a None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.923762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8c7e3-112f-455b-b0b5-612319e1834a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.923871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa76ba0-b5a7-4719-af4a-b04f3a636089 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.924263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8c7e3-112f-455b-b0b5-612319e1834a None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.926515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 321/654] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:13 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:13.927447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8c7e3-112f-455b-b0b5-612319e1834a None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.940006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 334/655] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:13.941355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f4268-d6aa-4fd4-aea6-c1b3fec48070 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.941646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f4268-d6aa-4fd4-aea6-c1b3fec48070 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.941926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f4268-d6aa-4fd4-aea6-c1b3fec48070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.942225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8c7e3-112f-455b-b0b5-612319e1834a None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:13.947007 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5d38-a55c-47c0-aeb3-bacb955955d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:13.947789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5d38-a55c-47c0-aeb3-bacb955955d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:13.948276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5d38-a55c-47c0-aeb3-bacb955955d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:13.948574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5d38-a55c-47c0-aeb3-bacb955955d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:13.961023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5d38-a55c-47c0-aeb3-bacb955955d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:13.962940 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5d38-a55c-47c0-aeb3-bacb955955d9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:13.963077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-fe1f4268-d6aa-4fd4-aea6-c1b3fec48070 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:13.964153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-fe1f4268-d6aa-4fd4-aea6-c1b3fec48070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:13.974585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 335/656] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:13 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:13.976126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f4268-d6aa-4fd4-aea6-c1b3fec48070 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.985371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-1eee5d38-a55c-47c0-aeb3-bacb955955d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:13.991724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 322/657] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:13.993461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5d38-a55c-47c0-aeb3-bacb955955d9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:13.998245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f4268-d6aa-4fd4-aea6-c1b3fec48070 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.003780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5d38-a55c-47c0-aeb3-bacb955955d9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.009678 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670f804-ad92-401a-8522-b99b625a590d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.010444 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670f804-ad92-401a-8522-b99b625a590d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.010733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670f804-ad92-401a-8522-b99b625a590d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.011073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670f804-ad92-401a-8522-b99b625a590d admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.012070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670f804-ad92-401a-8522-b99b625a590d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:14.012385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670f804-ad92-401a-8522-b99b625a590d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.014688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670f804-ad92-401a-8522-b99b625a590d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.015363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d23dbe-6f89-47b7-9f8b-081a374d768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.016164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d23dbe-6f89-47b7-9f8b-081a374d768f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.016447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d23dbe-6f89-47b7-9f8b-081a374d768f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.016728 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d23dbe-6f89-47b7-9f8b-081a374d768f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.025373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d23dbe-6f89-47b7-9f8b-081a374d768f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.027361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d23dbe-6f89-47b7-9f8b-081a374d768f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.033558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 323/658] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:14.034685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670f804-ad92-401a-8522-b99b625a590d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.041663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-61d23dbe-6f89-47b7-9f8b-081a374d768f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:14.042873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 336/659] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:14.046914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d23dbe-6f89-47b7-9f8b-081a374d768f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.052992 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670f804-ad92-401a-8522-b99b625a590d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.057538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d23dbe-6f89-47b7-9f8b-081a374d768f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.058229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913cd3b-3092-44f3-acfc-ba6dcf6c61e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.059464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913cd3b-3092-44f3-acfc-ba6dcf6c61e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.059983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913cd3b-3092-44f3-acfc-ba6dcf6c61e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.060512 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913cd3b-3092-44f3-acfc-ba6dcf6c61e9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.062117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88296008-ec26-4147-a31d-28227060cbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.063017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88296008-ec26-4147-a31d-28227060cbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.063300 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88296008-ec26-4147-a31d-28227060cbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.063573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88296008-ec26-4147-a31d-28227060cbc0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.072790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88296008-ec26-4147-a31d-28227060cbc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.073762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913cd3b-3092-44f3-acfc-ba6dcf6c61e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:14.074891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88296008-ec26-4147-a31d-28227060cbc0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.081025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-f913cd3b-3092-44f3-acfc-ba6dcf6c61e9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:14.082375 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 324/660] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:14.088391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913cd3b-3092-44f3-acfc-ba6dcf6c61e9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.090234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-88296008-ec26-4147-a31d-28227060cbc0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:14.096011 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 337/661] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:14.096861 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88296008-ec26-4147-a31d-28227060cbc0 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.099576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913cd3b-3092-44f3-acfc-ba6dcf6c61e9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.107168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9823c39-03a0-40d9-9c32-da66321a1f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.108006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823c39-03a0-40d9-9c32-da66321a1f14 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.108455 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823c39-03a0-40d9-9c32-da66321a1f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.108870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823c39-03a0-40d9-9c32-da66321a1f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.109602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88296008-ec26-4147-a31d-28227060cbc0 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.109972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9823c39-03a0-40d9-9c32-da66321a1f14 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:14.110421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9823c39-03a0-40d9-9c32-da66321a1f14 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.112455 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9823c39-03a0-40d9-9c32-da66321a1f14 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.114226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ab075-fb8d-4a47-b8ee-e69ade3bbc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.114997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ab075-fb8d-4a47-b8ee-e69ade3bbc69 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.115283 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ab075-fb8d-4a47-b8ee-e69ade3bbc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.115595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ab075-fb8d-4a47-b8ee-e69ade3bbc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.116522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ab075-fb8d-4a47-b8ee-e69ade3bbc69 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:14.117001 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ab075-fb8d-4a47-b8ee-e69ade3bbc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.118651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ab075-fb8d-4a47-b8ee-e69ade3bbc69 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.126728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 325/662] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:14.127773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9823c39-03a0-40d9-9c32-da66321a1f14 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.131750 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 338/663] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:14.138301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ab075-fb8d-4a47-b8ee-e69ade3bbc69 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.149439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9823c39-03a0-40d9-9c32-da66321a1f14 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.154393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733084b5-2b2a-4000-a924-ed7c4278cff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.155475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733084b5-2b2a-4000-a924-ed7c4278cff4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.155956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733084b5-2b2a-4000-a924-ed7c4278cff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.156379 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733084b5-2b2a-4000-a924-ed7c4278cff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.157376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733084b5-2b2a-4000-a924-ed7c4278cff4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:14.157828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733084b5-2b2a-4000-a924-ed7c4278cff4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.158290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ab075-fb8d-4a47-b8ee-e69ade3bbc69 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.160735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733084b5-2b2a-4000-a924-ed7c4278cff4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.163058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7faab9-8d78-431f-b73d-e6c5cd12772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.163682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faab9-8d78-431f-b73d-e6c5cd12772b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.163968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faab9-8d78-431f-b73d-e6c5cd12772b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.164246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faab9-8d78-431f-b73d-e6c5cd12772b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.165213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7faab9-8d78-431f-b73d-e6c5cd12772b admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=2691f7bb4ed84de4bb5901710a96d766) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:14.165392 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7faab9-8d78-431f-b73d-e6c5cd12772b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.167248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7faab9-8d78-431f-b73d-e6c5cd12772b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.180068 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 339/664] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/role_assignments?user.id=2691f7bb4ed84de4bb5901710a96d766&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 610 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:14.180068 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7faab9-8d78-431f-b73d-e6c5cd12772b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.180333 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 326/665] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:14.188122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733084b5-2b2a-4000-a924-ed7c4278cff4 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.206682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7faab9-8d78-431f-b73d-e6c5cd12772b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.209177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733084b5-2b2a-4000-a924-ed7c4278cff4 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.216691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f67e2-4de7-4925-9294-12e5cbf3e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.218532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f67e2-4de7-4925-9294-12e5cbf3e960 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.218841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f67e2-4de7-4925-9294-12e5cbf3e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.219120 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f67e2-4de7-4925-9294-12e5cbf3e960 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.221268 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a5437-5dcd-452e-a303-743d7123bf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.223115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5437-5dcd-452e-a303-743d7123bf21 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.223408 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5437-5dcd-452e-a303-743d7123bf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.223688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5437-5dcd-452e-a303-743d7123bf21 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.224565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a5437-5dcd-452e-a303-743d7123bf21 admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=aa9834b75e2b4ac787f3917564090d2d) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:14.224877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a5437-5dcd-452e-a303-743d7123bf21 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.227951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a5437-5dcd-452e-a303-743d7123bf21 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.234310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f67e2-4de7-4925-9294-12e5cbf3e960 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.236328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f67e2-4de7-4925-9294-12e5cbf3e960 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.242521 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 327/666] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/role_assignments?user.id=aa9834b75e2b4ac787f3917564090d2d&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 610 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:14.262705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-923f67e2-4de7-4925-9294-12e5cbf3e960 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:14.264262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 340/667] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:14.270465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a5437-5dcd-452e-a303-743d7123bf21 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.301212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a5437-5dcd-452e-a303-743d7123bf21 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.315764 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd009-a2ff-41d5-8446-92344c3b0182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.316640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd009-a2ff-41d5-8446-92344c3b0182 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.317025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd009-a2ff-41d5-8446-92344c3b0182 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.317422 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd009-a2ff-41d5-8446-92344c3b0182 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.318324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fd009-a2ff-41d5-8446-92344c3b0182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:14.318733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fd009-a2ff-41d5-8446-92344c3b0182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.321702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fd009-a2ff-41d5-8446-92344c3b0182 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.349155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 328/668] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:14.355521 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f67e2-4de7-4925-9294-12e5cbf3e960 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.375889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f67e2-4de7-4925-9294-12e5cbf3e960 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.386685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfea416-4edc-43df-83a9-14bfadc556b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.387523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfea416-4edc-43df-83a9-14bfadc556b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.387806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfea416-4edc-43df-83a9-14bfadc556b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.388070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfea416-4edc-43df-83a9-14bfadc556b1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.396145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfea416-4edc-43df-83a9-14bfadc556b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.398800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfea416-4edc-43df-83a9-14bfadc556b1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.414966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-6cfea416-4edc-43df-83a9-14bfadc556b1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 24 16:38:14.416532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 341/669] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:14.423115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd009-a2ff-41d5-8446-92344c3b0182 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.436078 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd009-a2ff-41d5-8446-92344c3b0182 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.441573 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d98e3-e064-4e96-bb4a-61f340869805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.442349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d98e3-e064-4e96-bb4a-61f340869805 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.442696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d98e3-e064-4e96-bb4a-61f340869805 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.443085 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d98e3-e064-4e96-bb4a-61f340869805 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.444564 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d98e3-e064-4e96-bb4a-61f340869805 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:14.444926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d98e3-e064-4e96-bb4a-61f340869805 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.446981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d98e3-e064-4e96-bb4a-61f340869805 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.472915 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 329/670] 10.222.0.117 () {56 vars in 1161 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:14.478912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfea416-4edc-43df-83a9-14bfadc556b1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.493445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfea416-4edc-43df-83a9-14bfadc556b1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.498713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144367ba-259a-48eb-9040-2ed42bdef306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.499527 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144367ba-259a-48eb-9040-2ed42bdef306 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.499811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144367ba-259a-48eb-9040-2ed42bdef306 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.500086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144367ba-259a-48eb-9040-2ed42bdef306 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.514806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144367ba-259a-48eb-9040-2ed42bdef306 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.516676 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144367ba-259a-48eb-9040-2ed42bdef306 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.537940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-144367ba-259a-48eb-9040-2ed42bdef306 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:14.539487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 342/671] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:14.545759 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d98e3-e064-4e96-bb4a-61f340869805 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.559866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d98e3-e064-4e96-bb4a-61f340869805 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.565796 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e67c32-cac6-49fa-a69b-01d00ebaecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.566540 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e67c32-cac6-49fa-a69b-01d00ebaecde admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.567197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e67c32-cac6-49fa-a69b-01d00ebaecde admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.567197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e67c32-cac6-49fa-a69b-01d00ebaecde admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.568683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e67c32-cac6-49fa-a69b-01d00ebaecde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:14.568683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e67c32-cac6-49fa-a69b-01d00ebaecde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.570935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e67c32-cac6-49fa-a69b-01d00ebaecde admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.583825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 330/672] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:14.590530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144367ba-259a-48eb-9040-2ed42bdef306 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.600732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144367ba-259a-48eb-9040-2ed42bdef306 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.605939 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1026c6-72d3-44db-918b-c42383243682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.606873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1026c6-72d3-44db-918b-c42383243682 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.607273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1026c6-72d3-44db-918b-c42383243682 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.607628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1026c6-72d3-44db-918b-c42383243682 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.616371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1026c6-72d3-44db-918b-c42383243682 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.618454 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1026c6-72d3-44db-918b-c42383243682 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.632865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-4b1026c6-72d3-44db-918b-c42383243682 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:14.634511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 343/673] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:14.640129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e67c32-cac6-49fa-a69b-01d00ebaecde admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.651385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e67c32-cac6-49fa-a69b-01d00ebaecde admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.658181 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf4588-8580-4c0c-8c9e-5173d2dcd832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.658963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf4588-8580-4c0c-8c9e-5173d2dcd832 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.659359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf4588-8580-4c0c-8c9e-5173d2dcd832 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.659711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf4588-8580-4c0c-8c9e-5173d2dcd832 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.660649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf4588-8580-4c0c-8c9e-5173d2dcd832 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:14.661118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf4588-8580-4c0c-8c9e-5173d2dcd832 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.663749 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf4588-8580-4c0c-8c9e-5173d2dcd832 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.677702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 331/674] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:14.684751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1026c6-72d3-44db-918b-c42383243682 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:14.701023 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1026c6-72d3-44db-918b-c42383243682 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:14.708180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38579ff5-8d87-4b5f-842c-6a82ab7baa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:14.709156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38579ff5-8d87-4b5f-842c-6a82ab7baa6d admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:14.709512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38579ff5-8d87-4b5f-842c-6a82ab7baa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:14.710392 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38579ff5-8d87-4b5f-842c-6a82ab7baa6d admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/6a6d64d2408e481db883823e98f4d831/roles/adcc0add18bc4deebfb1e1785ed0297b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:14.734309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38579ff5-8d87-4b5f-842c-6a82ab7baa6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=6a6d64d2408e481db883823e98f4d831, role_id=adcc0add18bc4deebfb1e1785ed0297b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:14.736748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38579ff5-8d87-4b5f-842c-6a82ab7baa6d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:14.759561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 344/675] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:38:14 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/6a6d64d2408e481db883823e98f4d831/roles/adcc0add18bc4deebfb1e1785ed0297b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:38:16.280507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df9e53-0ed6-486d-9c79-7b04f965721f None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.281016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df9e53-0ed6-486d-9c79-7b04f965721f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.281196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df9e53-0ed6-486d-9c79-7b04f965721f None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.283061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 332/676] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:16.288625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2839f-e3d3-4d9f-9f41-ea8226059d7e None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.289096 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2839f-e3d3-4d9f-9f41-ea8226059d7e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.289312 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2839f-e3d3-4d9f-9f41-ea8226059d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.315684 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-2bc2839f-e3d3-4d9f-9f41-ea8226059d7e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:16.316938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2bc2839f-e3d3-4d9f-9f41-ea8226059d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:16.390739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 345/677] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:16 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:16.427568 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df9e53-0ed6-486d-9c79-7b04f965721f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.444425 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df9e53-0ed6-486d-9c79-7b04f965721f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.449008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3abdd-c784-41fb-a81b-c2c3396ad982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.449867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3abdd-c784-41fb-a81b-c2c3396ad982 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.450219 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3abdd-c784-41fb-a81b-c2c3396ad982 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.450640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3abdd-c784-41fb-a81b-c2c3396ad982 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.452202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ee7d1-5ea0-42aa-8789-24027803dbb7 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.452552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ee7d1-5ea0-42aa-8789-24027803dbb7 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.452890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ee7d1-5ea0-42aa-8789-24027803dbb7 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.454858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 346/678] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:16.460582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26318fc4-7fc5-46d8-bfab-c35e25eea8de None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.460873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26318fc4-7fc5-46d8-bfab-c35e25eea8de None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.461147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26318fc4-7fc5-46d8-bfab-c35e25eea8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.473851 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3abdd-c784-41fb-a81b-c2c3396ad982 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:16.484946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-80b3abdd-c784-41fb-a81b-c2c3396ad982 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:38:16.487625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 333/679] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:16.495782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3abdd-c784-41fb-a81b-c2c3396ad982 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.497146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-26318fc4-7fc5-46d8-bfab-c35e25eea8de None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:16.498479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-26318fc4-7fc5-46d8-bfab-c35e25eea8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:16.505834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3abdd-c784-41fb-a81b-c2c3396ad982 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.510973 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10152200-881d-448a-9841-626f66bad97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.511856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10152200-881d-448a-9841-626f66bad97a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.512209 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10152200-881d-448a-9841-626f66bad97a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.512552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10152200-881d-448a-9841-626f66bad97a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.513386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10152200-881d-448a-9841-626f66bad97a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:16.513760 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10152200-881d-448a-9841-626f66bad97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:16.514708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 347/680] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:16 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:38:16.518774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10152200-881d-448a-9841-626f66bad97a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:16.528200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 334/681] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:16.536025 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26318fc4-7fc5-46d8-bfab-c35e25eea8de None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.542784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10152200-881d-448a-9841-626f66bad97a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.550483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26318fc4-7fc5-46d8-bfab-c35e25eea8de None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.552554 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10152200-881d-448a-9841-626f66bad97a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.560688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4803-cd62-4f36-928a-b61efa060c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.561412 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91161ff7-072a-4167-ada5-6550e2df9856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.562282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4803-cd62-4f36-928a-b61efa060c03 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.563156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91161ff7-072a-4167-ada5-6550e2df9856 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.563501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4803-cd62-4f36-928a-b61efa060c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.563833 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4803-cd62-4f36-928a-b61efa060c03 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.564159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91161ff7-072a-4167-ada5-6550e2df9856 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.564901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4803-cd62-4f36-928a-b61efa060c03 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:16.565241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91161ff7-072a-4167-ada5-6550e2df9856 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.566810 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-95af4803-cd62-4f36-928a-b61efa060c03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:16.566810 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:38:16.566810 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:38:16.568025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4803-cd62-4f36-928a-b61efa060c03 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:16.588697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-95af4803-cd62-4f36-928a-b61efa060c03 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 24 16:38:16.593555 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91161ff7-072a-4167-ada5-6550e2df9856 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:16.595470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91161ff7-072a-4167-ada5-6550e2df9856 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:16.597589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 335/682] 10.222.0.117 () {56 vars in 1155 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:16.610914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4803-cd62-4f36-928a-b61efa060c03 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.626305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4803-cd62-4f36-928a-b61efa060c03 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.629940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-91161ff7-072a-4167-ada5-6550e2df9856 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:16.632328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 348/683] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:16.636410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d57c74-0d2a-4d93-9c18-4e984e6d8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.637173 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d57c74-0d2a-4d93-9c18-4e984e6d8de5 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.638143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91161ff7-072a-4167-ada5-6550e2df9856 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.638494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d57c74-0d2a-4d93-9c18-4e984e6d8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.639201 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d57c74-0d2a-4d93-9c18-4e984e6d8de5 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.640404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d57c74-0d2a-4d93-9c18-4e984e6d8de5 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:16.641777 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d57c74-0d2a-4d93-9c18-4e984e6d8de5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:16.642900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-e5d57c74-0d2a-4d93-9c18-4e984e6d8de5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:16.642900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:38:16.642900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:38:16.647050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d57c74-0d2a-4d93-9c18-4e984e6d8de5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:16.654528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 336/684] 10.222.0.117 () {56 vars in 1150 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:16.656752 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91161ff7-072a-4167-ada5-6550e2df9856 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.664311 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dda9e-fb28-45c1-bbc9-c17fdc476568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.664974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dda9e-fb28-45c1-bbc9-c17fdc476568 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.665259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dda9e-fb28-45c1-bbc9-c17fdc476568 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.665411 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d57c74-0d2a-4d93-9c18-4e984e6d8de5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.665514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dda9e-fb28-45c1-bbc9-c17fdc476568 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.666260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dda9e-fb28-45c1-bbc9-c17fdc476568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:16.666677 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dda9e-fb28-45c1-bbc9-c17fdc476568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:16.668297 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dda9e-fb28-45c1-bbc9-c17fdc476568 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:16.679923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d57c74-0d2a-4d93-9c18-4e984e6d8de5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.680799 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 349/685] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:16.685908 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dda9e-fb28-45c1-bbc9-c17fdc476568 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.695039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15b5dc-9912-4d7c-9fb0-614509a17b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.695799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15b5dc-9912-4d7c-9fb0-614509a17b60 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.696152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15b5dc-9912-4d7c-9fb0-614509a17b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.696501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15b5dc-9912-4d7c-9fb0-614509a17b60 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.697307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15b5dc-9912-4d7c-9fb0-614509a17b60 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:16.698864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15b5dc-9912-4d7c-9fb0-614509a17b60 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:16.700546 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15b5dc-9912-4d7c-9fb0-614509a17b60 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:16.703069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dda9e-fb28-45c1-bbc9-c17fdc476568 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.719687 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b8ca4-56d0-418d-bdbd-50229f321312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.719903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 337/686] 10.222.0.117 () {56 vars in 1150 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:16.720708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b8ca4-56d0-418d-bdbd-50229f321312 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.721061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b8ca4-56d0-418d-bdbd-50229f321312 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.721406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b8ca4-56d0-418d-bdbd-50229f321312 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.730978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b8ca4-56d0-418d-bdbd-50229f321312 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:16.733047 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b8ca4-56d0-418d-bdbd-50229f321312 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:16.753875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-181b8ca4-56d0-418d-bdbd-50229f321312 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 24 16:38:16.759761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 350/687] 10.222.0.117 () {56 vars in 1119 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:16.765325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15b5dc-9912-4d7c-9fb0-614509a17b60 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.780580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15b5dc-9912-4d7c-9fb0-614509a17b60 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.788643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3adafa-016a-4e59-99d4-f9a2eca1b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.789433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3adafa-016a-4e59-99d4-f9a2eca1b8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.789791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3adafa-016a-4e59-99d4-f9a2eca1b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.790139 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3adafa-016a-4e59-99d4-f9a2eca1b8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.791104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3adafa-016a-4e59-99d4-f9a2eca1b8e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:16.791487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3adafa-016a-4e59-99d4-f9a2eca1b8e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:16.793405 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3adafa-016a-4e59-99d4-f9a2eca1b8e7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:16.822499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 338/688] 10.222.0.117 () {56 vars in 1159 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:16.828212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b8ca4-56d0-418d-bdbd-50229f321312 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.839447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b8ca4-56d0-418d-bdbd-50229f321312 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.849835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cfb79-e447-47e2-9135-f457d4dc1ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.850623 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cfb79-e447-47e2-9135-f457d4dc1ddf admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.851002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cfb79-e447-47e2-9135-f457d4dc1ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.851347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cfb79-e447-47e2-9135-f457d4dc1ddf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.860429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cfb79-e447-47e2-9135-f457d4dc1ddf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:16.862318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cfb79-e447-47e2-9135-f457d4dc1ddf admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:16.879983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 351/689] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:38:16.886686 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3adafa-016a-4e59-99d4-f9a2eca1b8e7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.900918 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3adafa-016a-4e59-99d4-f9a2eca1b8e7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.912250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733599b1-f01f-4803-a75e-6b7f5e6784f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.913346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733599b1-f01f-4803-a75e-6b7f5e6784f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.913703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733599b1-f01f-4803-a75e-6b7f5e6784f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.914056 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733599b1-f01f-4803-a75e-6b7f5e6784f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.925557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733599b1-f01f-4803-a75e-6b7f5e6784f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:16.927739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733599b1-f01f-4803-a75e-6b7f5e6784f1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:16.948154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-733599b1-f01f-4803-a75e-6b7f5e6784f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:16.950144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 339/690] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:16.957336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cfb79-e447-47e2-9135-f457d4dc1ddf admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:16.967627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cfb79-e447-47e2-9135-f457d4dc1ddf admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:16.992038 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865ee5e-a3a1-4597-8764-2b222e576c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:16.992958 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865ee5e-a3a1-4597-8764-2b222e576c13 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:16.993348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865ee5e-a3a1-4597-8764-2b222e576c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:16.993885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865ee5e-a3a1-4597-8764-2b222e576c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:16.994780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865ee5e-a3a1-4597-8764-2b222e576c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:16.995278 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865ee5e-a3a1-4597-8764-2b222e576c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:16.997002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865ee5e-a3a1-4597-8764-2b222e576c13 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:17.019952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 352/691] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:17.025448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733599b1-f01f-4803-a75e-6b7f5e6784f1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:17.037896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733599b1-f01f-4803-a75e-6b7f5e6784f1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:17.044782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd594fd-d0cf-43cd-93de-2da503b061b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:17.045855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd594fd-d0cf-43cd-93de-2da503b061b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.046296 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd594fd-d0cf-43cd-93de-2da503b061b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.046669 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd594fd-d0cf-43cd-93de-2da503b061b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.055049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd594fd-d0cf-43cd-93de-2da503b061b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:17.057143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd594fd-d0cf-43cd-93de-2da503b061b4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:17.071190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-cdd594fd-d0cf-43cd-93de-2da503b061b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:17.072862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 340/692] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:17.078277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865ee5e-a3a1-4597-8764-2b222e576c13 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:17.088815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865ee5e-a3a1-4597-8764-2b222e576c13 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:17.096860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c121d5-cb0d-4164-919a-b974491867b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:17.097639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c121d5-cb0d-4164-919a-b974491867b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.098098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c121d5-cb0d-4164-919a-b974491867b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.098465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c121d5-cb0d-4164-919a-b974491867b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.099419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c121d5-cb0d-4164-919a-b974491867b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:17.100694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c121d5-cb0d-4164-919a-b974491867b3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:17.103174 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c121d5-cb0d-4164-919a-b974491867b3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:17.107358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e424540-7dcd-4f9e-ae40-e2953488c2cb None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.109887 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e424540-7dcd-4f9e-ae40-e2953488c2cb None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.110280 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e424540-7dcd-4f9e-ae40-e2953488c2cb None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.112368 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 341/693] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:17 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:17.125575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd269d-4854-4072-bca9-1c4af3a3826f None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.125872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd269d-4854-4072-bca9-1c4af3a3826f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.126153 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd269d-4854-4072-bca9-1c4af3a3826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.128747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 353/694] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:17.138799 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c121d5-cb0d-4164-919a-b974491867b3 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:17.149870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c121d5-cb0d-4164-919a-b974491867b3 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:17.150118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-43dd269d-4854-4072-bca9-1c4af3a3826f None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:17.153286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-43dd269d-4854-4072-bca9-1c4af3a3826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:17.161086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879d590-91d3-4365-b9a5-483d4e9627f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:17.161237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 342/695] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:17 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:38:17.162038 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879d590-91d3-4365-b9a5-483d4e9627f4 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.162317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879d590-91d3-4365-b9a5-483d4e9627f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.162651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879d590-91d3-4365-b9a5-483d4e9627f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.173276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879d590-91d3-4365-b9a5-483d4e9627f4 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=37c91fefe89a45b48df82a311e771ea3) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:17.173276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879d590-91d3-4365-b9a5-483d4e9627f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:17.173822 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879d590-91d3-4365-b9a5-483d4e9627f4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:17.183088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdb67-c3c7-4bd3-bde8-ab8104f9a37e None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.183668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdb67-c3c7-4bd3-bde8-ab8104f9a37e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.184166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdb67-c3c7-4bd3-bde8-ab8104f9a37e None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.186644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 354/696] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:17 2022] GET /identity/v3/role_assignments?user.id=37c91fefe89a45b48df82a311e771ea3&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:17.189896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 343/697] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:17 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:17.195683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879d590-91d3-4365-b9a5-483d4e9627f4 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:17.196502 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c053c2e-6e46-425f-ab87-f64ab99bb4fa None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.196995 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c053c2e-6e46-425f-ab87-f64ab99bb4fa None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.197627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c053c2e-6e46-425f-ab87-f64ab99bb4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.206220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879d590-91d3-4365-b9a5-483d4e9627f4 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:17.220610 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-6c053c2e-6e46-425f-ab87-f64ab99bb4fa None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:17.222434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-6c053c2e-6e46-425f-ab87-f64ab99bb4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:17.226345 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c5371-e059-4023-ac64-88af9e45c539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:17.227432 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c5371-e059-4023-ac64-88af9e45c539 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.227707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c5371-e059-4023-ac64-88af9e45c539 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.227970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c5371-e059-4023-ac64-88af9e45c539 admin admin] PATH_INFO: `/v3/services/network` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.228742 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c5371-e059-4023-ac64-88af9e45c539 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:17.229880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-8d6c5371-e059-4023-ac64-88af9e45c539 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:17.229880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:38:17.229880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:38:17.230771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c5371-e059-4023-ac64-88af9e45c539 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:17.233679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 344/698] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:17 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:17.245209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-8d6c5371-e059-4023-ac64-88af9e45c539 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 24 16:38:17.246788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 355/699] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:17 2022] GET /identity/v3/services/network => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:17.252656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c053c2e-6e46-425f-ab87-f64ab99bb4fa None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:17.262708 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c053c2e-6e46-425f-ab87-f64ab99bb4fa None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:17.267420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089086e-7a21-4ad4-827f-8194bd843a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:17.268096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089086e-7a21-4ad4-827f-8194bd843a23 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.268376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089086e-7a21-4ad4-827f-8194bd843a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.268709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089086e-7a21-4ad4-827f-8194bd843a23 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.269491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089086e-7a21-4ad4-827f-8194bd843a23 admin admin] RBAC: Adding query filter params (name=network) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:17.269798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089086e-7a21-4ad4-827f-8194bd843a23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:17.271302 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c5371-e059-4023-ac64-88af9e45c539 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:17.284115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089086e-7a21-4ad4-827f-8194bd843a23 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:17.285716 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c5371-e059-4023-ac64-88af9e45c539 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:17.294012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 345/700] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:17 2022] GET /identity/v3/services?name=network => generated 125 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:17.300221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584a450-1da9-49ed-8fee-ed7d7e06f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:17.300964 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089086e-7a21-4ad4-827f-8194bd843a23 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:17.302359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584a450-1da9-49ed-8fee-ed7d7e06f46d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.302641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584a450-1da9-49ed-8fee-ed7d7e06f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.304188 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584a450-1da9-49ed-8fee-ed7d7e06f46d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.323883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089086e-7a21-4ad4-827f-8194bd843a23 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:17.327745 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584a450-1da9-49ed-8fee-ed7d7e06f46d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:17.330271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584a450-1da9-49ed-8fee-ed7d7e06f46d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:17.340199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab336eb-bce7-48e0-a441-beb505e2c6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:17.340863 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab336eb-bce7-48e0-a441-beb505e2c6dc admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.341139 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab336eb-bce7-48e0-a441-beb505e2c6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.341410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab336eb-bce7-48e0-a441-beb505e2c6dc admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.342123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab336eb-bce7-48e0-a441-beb505e2c6dc admin admin] RBAC: Adding query filter params (type=network) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:17.342424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab336eb-bce7-48e0-a441-beb505e2c6dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:17.347552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab336eb-bce7-48e0-a441-beb505e2c6dc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:17.359751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 346/701] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:17 2022] GET /identity/v3/services?type=network => generated 125 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:17.360066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-c584a450-1da9-49ed-8fee-ed7d7e06f46d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:17.367436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab336eb-bce7-48e0-a441-beb505e2c6dc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:17.367891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 356/702] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:17.385628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab336eb-bce7-48e0-a441-beb505e2c6dc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:17.400311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeb84b-ca10-47b0-94c6-ff33d44ad70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:17.400990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeb84b-ca10-47b0-94c6-ff33d44ad70d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.401283 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeb84b-ca10-47b0-94c6-ff33d44ad70d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.401543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeb84b-ca10-47b0-94c6-ff33d44ad70d admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.402287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeb84b-ca10-47b0-94c6-ff33d44ad70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:17.402589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeb84b-ca10-47b0-94c6-ff33d44ad70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:17.404205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeb84b-ca10-47b0-94c6-ff33d44ad70d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:17.428715 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 347/703] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:17.433993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584a450-1da9-49ed-8fee-ed7d7e06f46d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:17.448685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584a450-1da9-49ed-8fee-ed7d7e06f46d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:17.464704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e444887-e4d6-426f-9e01-e72e639b3624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:17.465295 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444887-e4d6-426f-9e01-e72e639b3624 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:17.465570 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444887-e4d6-426f-9e01-e72e639b3624 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:17.465840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444887-e4d6-426f-9e01-e72e639b3624 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:17.466577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e444887-e4d6-426f-9e01-e72e639b3624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:17.468520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e444887-e4d6-426f-9e01-e72e639b3624 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:17.506561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 357/704] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:38:17 2022] POST /identity/v3/users => generated 255 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:18.037197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443774-e5a0-4a66-8655-fab60e9a9522 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.037197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443774-e5a0-4a66-8655-fab60e9a9522 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.037197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443774-e5a0-4a66-8655-fab60e9a9522 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.038600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 348/705] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:18 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:18.044128 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c457ac-def3-4b52-b266-38c2e3834bd0 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.044648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c457ac-def3-4b52-b266-38c2e3834bd0 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.045126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c457ac-def3-4b52-b266-38c2e3834bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.063591 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a2c457ac-def3-4b52-b266-38c2e3834bd0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:18.065067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a2c457ac-def3-4b52-b266-38c2e3834bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:18.078856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 358/706] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:18 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 24 16:38:18.098517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47443774-e5a0-4a66-8655-fab60e9a9522 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.111664 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47443774-e5a0-4a66-8655-fab60e9a9522 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.116415 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2777a-ccc5-4d36-915a-ca997be58d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.117416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2777a-ccc5-4d36-915a-ca997be58d13 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.117899 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2777a-ccc5-4d36-915a-ca997be58d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.118372 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2777a-ccc5-4d36-915a-ca997be58d13 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.129790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2777a-ccc5-4d36-915a-ca997be58d13 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:18.137709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-63c2777a-ccc5-4d36-915a-ca997be58d13 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:18.142846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 349/707] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:18.145610 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c457ac-def3-4b52-b266-38c2e3834bd0 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.156418 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c457ac-def3-4b52-b266-38c2e3834bd0 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.161170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54151b23-085e-40b1-8e86-f531ad964c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.162064 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54151b23-085e-40b1-8e86-f531ad964c95 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.162602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54151b23-085e-40b1-8e86-f531ad964c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.163148 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54151b23-085e-40b1-8e86-f531ad964c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.167696 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54151b23-085e-40b1-8e86-f531ad964c95 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:18.168277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54151b23-085e-40b1-8e86-f531ad964c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:18.170171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54151b23-085e-40b1-8e86-f531ad964c95 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:18.184071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 359/708] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:18.185671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2777a-ccc5-4d36-915a-ca997be58d13 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.196647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2777a-ccc5-4d36-915a-ca997be58d13 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.201458 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb234-7dfa-4d83-8c2e-ec0af81e1a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.202473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb234-7dfa-4d83-8c2e-ec0af81e1a5a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.202983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb234-7dfa-4d83-8c2e-ec0af81e1a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.203457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb234-7dfa-4d83-8c2e-ec0af81e1a5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.215344 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eb234-7dfa-4d83-8c2e-ec0af81e1a5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:18.217493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eb234-7dfa-4d83-8c2e-ec0af81e1a5a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:18.235603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-d29eb234-7dfa-4d83-8c2e-ec0af81e1a5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:18.241805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 350/709] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:18.243451 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54151b23-085e-40b1-8e86-f531ad964c95 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.254063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54151b23-085e-40b1-8e86-f531ad964c95 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.260150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e5e2-bbfd-4162-acef-e65b290416e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.261175 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e5e2-bbfd-4162-acef-e65b290416e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.261659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e5e2-bbfd-4162-acef-e65b290416e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.262135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e5e2-bbfd-4162-acef-e65b290416e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.263169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446e5e2-bbfd-4162-acef-e65b290416e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:18.263712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446e5e2-bbfd-4162-acef-e65b290416e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:18.265539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446e5e2-bbfd-4162-acef-e65b290416e8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:18.283874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 360/710] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:18.285505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb234-7dfa-4d83-8c2e-ec0af81e1a5a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.296256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb234-7dfa-4d83-8c2e-ec0af81e1a5a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.301004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3e76a-5931-428e-b241-02b28e9124c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.302021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3e76a-5931-428e-b241-02b28e9124c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.302502 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3e76a-5931-428e-b241-02b28e9124c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.303051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3e76a-5931-428e-b241-02b28e9124c1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.310921 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3e76a-5931-428e-b241-02b28e9124c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:18.313204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3e76a-5931-428e-b241-02b28e9124c1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:18.331444 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-25f3e76a-5931-428e-b241-02b28e9124c1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 24 16:38:18.338255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 351/711] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:18.339889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e5e2-bbfd-4162-acef-e65b290416e8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.350539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e5e2-bbfd-4162-acef-e65b290416e8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.355832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f467fe-7a6e-4aed-8ac5-458b37dc8f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.356717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f467fe-7a6e-4aed-8ac5-458b37dc8f81 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.357216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f467fe-7a6e-4aed-8ac5-458b37dc8f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.357688 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f467fe-7a6e-4aed-8ac5-458b37dc8f81 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.358734 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f467fe-7a6e-4aed-8ac5-458b37dc8f81 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:18.359294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f467fe-7a6e-4aed-8ac5-458b37dc8f81 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:18.361326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f467fe-7a6e-4aed-8ac5-458b37dc8f81 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:18.382889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 361/712] 10.222.0.117 () {56 vars in 1161 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:18.386696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3e76a-5931-428e-b241-02b28e9124c1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.396903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3e76a-5931-428e-b241-02b28e9124c1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.401810 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3247b-dbb7-4047-8125-c83617140d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.402689 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3247b-dbb7-4047-8125-c83617140d3a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.403194 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3247b-dbb7-4047-8125-c83617140d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.403665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3247b-dbb7-4047-8125-c83617140d3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.412265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3247b-dbb7-4047-8125-c83617140d3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:18.414965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3247b-dbb7-4047-8125-c83617140d3a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:18.424675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 352/713] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:38:18.430891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f467fe-7a6e-4aed-8ac5-458b37dc8f81 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.440574 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f467fe-7a6e-4aed-8ac5-458b37dc8f81 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.445807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e9914-ce9c-41f6-9ff7-234a1e0950f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.446589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e9914-ce9c-41f6-9ff7-234a1e0950f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.446896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e9914-ce9c-41f6-9ff7-234a1e0950f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.447173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e9914-ce9c-41f6-9ff7-234a1e0950f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.457849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e9914-ce9c-41f6-9ff7-234a1e0950f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:18.460889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e9914-ce9c-41f6-9ff7-234a1e0950f7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:18.479369 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-849e9914-ce9c-41f6-9ff7-234a1e0950f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:18.480836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 362/714] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:18.486201 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3247b-dbb7-4047-8125-c83617140d3a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.495810 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3247b-dbb7-4047-8125-c83617140d3a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.508235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701a2e9-968f-410c-9cdf-963113673873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.509193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701a2e9-968f-410c-9cdf-963113673873 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.509676 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701a2e9-968f-410c-9cdf-963113673873 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.510193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701a2e9-968f-410c-9cdf-963113673873 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.511158 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701a2e9-968f-410c-9cdf-963113673873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:18.511688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701a2e9-968f-410c-9cdf-963113673873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:18.513463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701a2e9-968f-410c-9cdf-963113673873 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:18.531084 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 353/715] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:18.535972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e9914-ce9c-41f6-9ff7-234a1e0950f7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.551757 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e9914-ce9c-41f6-9ff7-234a1e0950f7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.564259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721e757-1a65-4e8d-ac73-0091f246cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.565049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e757-1a65-4e8d-ac73-0091f246cd8f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.565330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e757-1a65-4e8d-ac73-0091f246cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.565604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e757-1a65-4e8d-ac73-0091f246cd8f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.583938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721e757-1a65-4e8d-ac73-0091f246cd8f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:18.587124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721e757-1a65-4e8d-ac73-0091f246cd8f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:18.607622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-7721e757-1a65-4e8d-ac73-0091f246cd8f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:18.609102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 363/716] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:18.614637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701a2e9-968f-410c-9cdf-963113673873 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.625861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701a2e9-968f-410c-9cdf-963113673873 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.636126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b065c-8e8f-4cab-afac-622c2806fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.636991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b065c-8e8f-4cab-afac-622c2806fb8e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.637479 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b065c-8e8f-4cab-afac-622c2806fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.637898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b065c-8e8f-4cab-afac-622c2806fb8e admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.638933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b065c-8e8f-4cab-afac-622c2806fb8e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:18.639406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b065c-8e8f-4cab-afac-622c2806fb8e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:18.641433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b065c-8e8f-4cab-afac-622c2806fb8e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:18.660911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 354/717] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:18.668218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721e757-1a65-4e8d-ac73-0091f246cd8f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:18.693340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721e757-1a65-4e8d-ac73-0091f246cd8f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:18.707399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2198-63e7-4c27-a42a-6757d1af64e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:18.708187 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2198-63e7-4c27-a42a-6757d1af64e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:18.708574 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2198-63e7-4c27-a42a-6757d1af64e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:18.708979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2198-63e7-4c27-a42a-6757d1af64e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:18.711079 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e2198-63e7-4c27-a42a-6757d1af64e8 admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=6a6d64d2408e481db883823e98f4d831) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:18.711498 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e2198-63e7-4c27-a42a-6757d1af64e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:18.713440 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e2198-63e7-4c27-a42a-6757d1af64e8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:18.719905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 364/718] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:18 2022] GET /identity/v3/role_assignments?user.id=6a6d64d2408e481db883823e98f4d831&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 610 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:19.524229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57911ff-9a47-4494-af03-aa034fd35522 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:19.524735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57911ff-9a47-4494-af03-aa034fd35522 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:19.524928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57911ff-9a47-4494-af03-aa034fd35522 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:19.526906 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 355/719] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:19.532399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44bfd6-cddb-4a0d-aa0a-c47b2831aa97 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:19.532836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44bfd6-cddb-4a0d-aa0a-c47b2831aa97 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:19.533036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44bfd6-cddb-4a0d-aa0a-c47b2831aa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:19.559929 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-1f44bfd6-cddb-4a0d-aa0a-c47b2831aa97 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:19.561145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1f44bfd6-cddb-4a0d-aa0a-c47b2831aa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:19.573572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 365/720] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:19 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 24 16:38:19.596065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57911ff-9a47-4494-af03-aa034fd35522 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:19.613602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57911ff-9a47-4494-af03-aa034fd35522 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:19.623421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76d406-68e7-44c0-9d34-815c24c842dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:19.624100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76d406-68e7-44c0-9d34-815c24c842dd admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:19.624375 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76d406-68e7-44c0-9d34-815c24c842dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:19.624647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76d406-68e7-44c0-9d34-815c24c842dd admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:19.625401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76d406-68e7-44c0-9d34-815c24c842dd admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:19.626433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-fe76d406-68e7-44c0-9d34-815c24c842dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:19.626433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:38:19.626433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:38:19.627349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76d406-68e7-44c0-9d34-815c24c842dd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:19.651226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 356/721] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:38:19 2022] POST /identity/v3/services => generated 252 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:38:19.859578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543fac8-6144-4d51-b5fa-b9208d4a7559 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:19.859966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543fac8-6144-4d51-b5fa-b9208d4a7559 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:19.860135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543fac8-6144-4d51-b5fa-b9208d4a7559 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:19.861915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 366/722] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:19.869666 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e472f8-b80a-42c6-be5f-f424b8afcd16 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:19.869996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e472f8-b80a-42c6-be5f-f424b8afcd16 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:19.870208 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e472f8-b80a-42c6-be5f-f424b8afcd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:19.891109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-c4e472f8-b80a-42c6-be5f-f424b8afcd16 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:19.892287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c4e472f8-b80a-42c6-be5f-f424b8afcd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:19.915708 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 357/723] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:19 2022] POST /identity/v3/auth/tokens => generated 1019 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:19.938969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543fac8-6144-4d51-b5fa-b9208d4a7559 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:19.953393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543fac8-6144-4d51-b5fa-b9208d4a7559 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:19.959028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63d0f5-1b00-4d26-80ea-158800f5dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:19.960239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63d0f5-1b00-4d26-80ea-158800f5dedd admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:19.960667 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63d0f5-1b00-4d26-80ea-158800f5dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:19.960940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63d0f5-1b00-4d26-80ea-158800f5dedd admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:19.961682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63d0f5-1b00-4d26-80ea-158800f5dedd admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:19.962693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-5e63d0f5-1b00-4d26-80ea-158800f5dedd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:19.962693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:38:19.962693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:38:19.963599 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63d0f5-1b00-4d26-80ea-158800f5dedd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:19.983892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 367/724] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:38:19 2022] POST /identity/v3/services => generated 241 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:20.104808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c6d0-f7b8-4261-aded-2710133d1d03 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.105148 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c6d0-f7b8-4261-aded-2710133d1d03 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.105362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c6d0-f7b8-4261-aded-2710133d1d03 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.107429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 358/725] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:20.112566 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b89f25-9006-4838-82b0-36b9145f856c None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.112787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b89f25-9006-4838-82b0-36b9145f856c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.113065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b89f25-9006-4838-82b0-36b9145f856c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.139908 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-51b89f25-9006-4838-82b0-36b9145f856c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:20.141105 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-51b89f25-9006-4838-82b0-36b9145f856c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:20.179174 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 368/726] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:20 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:20.210835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38c6d0-f7b8-4261-aded-2710133d1d03 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:20.225470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38c6d0-f7b8-4261-aded-2710133d1d03 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:20.230717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea3714-17f7-4c6d-9b09-7c9e15ab8240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:20.231829 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea3714-17f7-4c6d-9b09-7c9e15ab8240 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.232361 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea3714-17f7-4c6d-9b09-7c9e15ab8240 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.232838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea3714-17f7-4c6d-9b09-7c9e15ab8240 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.246480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea3714-17f7-4c6d-9b09-7c9e15ab8240 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:20.253982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-4eea3714-17f7-4c6d-9b09-7c9e15ab8240 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:38:20.255807 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 359/727] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:20.261634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b89f25-9006-4838-82b0-36b9145f856c None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:20.275317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b89f25-9006-4838-82b0-36b9145f856c None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:20.281181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb918e-11aa-455b-a66a-76a71caf0d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:20.282078 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb918e-11aa-455b-a66a-76a71caf0d7e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.282583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb918e-11aa-455b-a66a-76a71caf0d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.283110 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb918e-11aa-455b-a66a-76a71caf0d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.284146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb918e-11aa-455b-a66a-76a71caf0d7e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:20.284658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb918e-11aa-455b-a66a-76a71caf0d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:20.286469 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb918e-11aa-455b-a66a-76a71caf0d7e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:20.296826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 369/728] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:20 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:20.301811 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea3714-17f7-4c6d-9b09-7c9e15ab8240 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:20.313030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea3714-17f7-4c6d-9b09-7c9e15ab8240 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:20.321782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89c18-e75f-49a2-abe4-56543256cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:20.322965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89c18-e75f-49a2-abe4-56543256cba2 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.323503 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89c18-e75f-49a2-abe4-56543256cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.323979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89c18-e75f-49a2-abe4-56543256cba2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.339042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab89c18-e75f-49a2-abe4-56543256cba2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:20.341265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab89c18-e75f-49a2-abe4-56543256cba2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:20.362027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-aab89c18-e75f-49a2-abe4-56543256cba2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:20.364075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 360/729] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:20.369307 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb918e-11aa-455b-a66a-76a71caf0d7e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:20.379766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb918e-11aa-455b-a66a-76a71caf0d7e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:20.386257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb15ef1-7dd4-4c66-9365-8ab1b51769e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:20.387279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15ef1-7dd4-4c66-9365-8ab1b51769e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.387842 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15ef1-7dd4-4c66-9365-8ab1b51769e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.388316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15ef1-7dd4-4c66-9365-8ab1b51769e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.389330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb15ef1-7dd4-4c66-9365-8ab1b51769e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:20.389837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb15ef1-7dd4-4c66-9365-8ab1b51769e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:20.391704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb15ef1-7dd4-4c66-9365-8ab1b51769e5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:20.405788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 370/730] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:20.410797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89c18-e75f-49a2-abe4-56543256cba2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:20.421314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89c18-e75f-49a2-abe4-56543256cba2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:20.427901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0768a-3783-4dd9-8e8d-313981e54b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:20.428978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0768a-3783-4dd9-8e8d-313981e54b68 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.429516 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0768a-3783-4dd9-8e8d-313981e54b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.430054 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0768a-3783-4dd9-8e8d-313981e54b68 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.439010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0768a-3783-4dd9-8e8d-313981e54b68 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:20.441315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0768a-3783-4dd9-8e8d-313981e54b68 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:20.455710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-d8a0768a-3783-4dd9-8e8d-313981e54b68 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 24 16:38:20.461086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 361/731] 10.222.0.117 () {56 vars in 1119 bytes} [Mon Jan 24 16:38:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:20.463307 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb15ef1-7dd4-4c66-9365-8ab1b51769e5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:20.481115 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb15ef1-7dd4-4c66-9365-8ab1b51769e5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:20.496324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce75ffa-6eba-4c56-9c77-04aeba73ef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:20.496988 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75ffa-6eba-4c56-9c77-04aeba73ef03 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.497271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75ffa-6eba-4c56-9c77-04aeba73ef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.497542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75ffa-6eba-4c56-9c77-04aeba73ef03 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.498393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce75ffa-6eba-4c56-9c77-04aeba73ef03 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:20.498696 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce75ffa-6eba-4c56-9c77-04aeba73ef03 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:20.504048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce75ffa-6eba-4c56-9c77-04aeba73ef03 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:20.530468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 371/732] 10.222.0.117 () {56 vars in 1159 bytes} [Mon Jan 24 16:38:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:20.535573 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0768a-3783-4dd9-8e8d-313981e54b68 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:20.547861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0768a-3783-4dd9-8e8d-313981e54b68 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:20.555071 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dff1ad-4dad-4704-ba06-14440d78c9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:20.555862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dff1ad-4dad-4704-ba06-14440d78c9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.556148 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dff1ad-4dad-4704-ba06-14440d78c9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.556424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dff1ad-4dad-4704-ba06-14440d78c9e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.573606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dff1ad-4dad-4704-ba06-14440d78c9e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:20.575471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dff1ad-4dad-4704-ba06-14440d78c9e0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:20.596467 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-e9dff1ad-4dad-4704-ba06-14440d78c9e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:20.597876 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 362/733] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:20.603734 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce75ffa-6eba-4c56-9c77-04aeba73ef03 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:20.620460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce75ffa-6eba-4c56-9c77-04aeba73ef03 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:20.629085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a863d-fc93-4604-b0de-155ca8dff7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:20.629766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a863d-fc93-4604-b0de-155ca8dff7de admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.630046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a863d-fc93-4604-b0de-155ca8dff7de admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.630321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a863d-fc93-4604-b0de-155ca8dff7de admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.631648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a863d-fc93-4604-b0de-155ca8dff7de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:20.632106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a863d-fc93-4604-b0de-155ca8dff7de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:20.633707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a863d-fc93-4604-b0de-155ca8dff7de admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:20.650377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 372/734] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:20.655727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dff1ad-4dad-4704-ba06-14440d78c9e0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:20.671830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dff1ad-4dad-4704-ba06-14440d78c9e0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:20.680309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16552c3-7072-47fc-8585-77be36c10b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:20.681099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16552c3-7072-47fc-8585-77be36c10b23 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.681368 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16552c3-7072-47fc-8585-77be36c10b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.681642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16552c3-7072-47fc-8585-77be36c10b23 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.695928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16552c3-7072-47fc-8585-77be36c10b23 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:20.697902 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16552c3-7072-47fc-8585-77be36c10b23 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:20.718671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-c16552c3-7072-47fc-8585-77be36c10b23 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:20.720169 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 363/735] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:20.725510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a863d-fc93-4604-b0de-155ca8dff7de admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:20.739385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a863d-fc93-4604-b0de-155ca8dff7de admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:20.748714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa92c1a-4a57-4c2b-afba-f5d017dcab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:20.749365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa92c1a-4a57-4c2b-afba-f5d017dcab59 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.749648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa92c1a-4a57-4c2b-afba-f5d017dcab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.749924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa92c1a-4a57-4c2b-afba-f5d017dcab59 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.750723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa92c1a-4a57-4c2b-afba-f5d017dcab59 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:20.751053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa92c1a-4a57-4c2b-afba-f5d017dcab59 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:20.752871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa92c1a-4a57-4c2b-afba-f5d017dcab59 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:20.769578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 373/736] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:20.775405 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16552c3-7072-47fc-8585-77be36c10b23 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:20.787757 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16552c3-7072-47fc-8585-77be36c10b23 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:20.794110 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526be39-6c42-4b56-aa6c-9450c1266e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:20.795025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526be39-6c42-4b56-aa6c-9450c1266e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.795303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526be39-6c42-4b56-aa6c-9450c1266e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.795577 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526be39-6c42-4b56-aa6c-9450c1266e60 admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/37c91fefe89a45b48df82a311e771ea3/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.797603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526be39-6c42-4b56-aa6c-9450c1266e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=37c91fefe89a45b48df82a311e771ea3, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:20.800248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526be39-6c42-4b56-aa6c-9450c1266e60 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:20.827091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 364/737] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:38:20 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/37c91fefe89a45b48df82a311e771ea3/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:38:20.988455 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fa7e6-e319-4898-a8bb-390ad0cc0047 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:20.988800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fa7e6-e319-4898-a8bb-390ad0cc0047 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:20.988970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fa7e6-e319-4898-a8bb-390ad0cc0047 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:20.991364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 374/738] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:21.000886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30ba8-7516-486b-a58c-28b480496c09 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.001211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30ba8-7516-486b-a58c-28b480496c09 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.001433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30ba8-7516-486b-a58c-28b480496c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.028244 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-62c30ba8-7516-486b-a58c-28b480496c09 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:21.029458 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-62c30ba8-7516-486b-a58c-28b480496c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:21.113905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 365/739] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:20 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:21.138967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fa7e6-e319-4898-a8bb-390ad0cc0047 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.152629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fa7e6-e319-4898-a8bb-390ad0cc0047 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.157700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376570e-d60f-4a58-adef-dbe42a345225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.158664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376570e-d60f-4a58-adef-dbe42a345225 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.159138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376570e-d60f-4a58-adef-dbe42a345225 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.159563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376570e-d60f-4a58-adef-dbe42a345225 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.172562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376570e-d60f-4a58-adef-dbe42a345225 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:21.180514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-a376570e-d60f-4a58-adef-dbe42a345225 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:21.182190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 375/740] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:21.188128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c30ba8-7516-486b-a58c-28b480496c09 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.197819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c30ba8-7516-486b-a58c-28b480496c09 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.203602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf48ac-54f3-4642-9709-39a459e30668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.204442 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf48ac-54f3-4642-9709-39a459e30668 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.204882 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf48ac-54f3-4642-9709-39a459e30668 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.205306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf48ac-54f3-4642-9709-39a459e30668 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.206218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf48ac-54f3-4642-9709-39a459e30668 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:21.206670 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf48ac-54f3-4642-9709-39a459e30668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:21.208473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf48ac-54f3-4642-9709-39a459e30668 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:21.218305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 366/741] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:21.223934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376570e-d60f-4a58-adef-dbe42a345225 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.234701 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376570e-d60f-4a58-adef-dbe42a345225 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.239780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339409f5-111f-4ca3-b70e-7f0954a5962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.241326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339409f5-111f-4ca3-b70e-7f0954a5962e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.242018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339409f5-111f-4ca3-b70e-7f0954a5962e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.242447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339409f5-111f-4ca3-b70e-7f0954a5962e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.258915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339409f5-111f-4ca3-b70e-7f0954a5962e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:21.260767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339409f5-111f-4ca3-b70e-7f0954a5962e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:21.290041 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-339409f5-111f-4ca3-b70e-7f0954a5962e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:21.291278 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 376/742] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:21.297266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf48ac-54f3-4642-9709-39a459e30668 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.314773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf48ac-54f3-4642-9709-39a459e30668 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.321271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e40c8-3ca3-4cdf-b5ce-311932ab3a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.322142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e40c8-3ca3-4cdf-b5ce-311932ab3a1c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.322628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e40c8-3ca3-4cdf-b5ce-311932ab3a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.323077 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e40c8-3ca3-4cdf-b5ce-311932ab3a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.323974 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e40c8-3ca3-4cdf-b5ce-311932ab3a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:21.324430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e40c8-3ca3-4cdf-b5ce-311932ab3a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:21.326428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e40c8-3ca3-4cdf-b5ce-311932ab3a1c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:21.349477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 367/743] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:21.355625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339409f5-111f-4ca3-b70e-7f0954a5962e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.371744 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339409f5-111f-4ca3-b70e-7f0954a5962e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.383425 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e41dbb-bd69-4003-aa69-29b8a8d0a5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.384418 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e41dbb-bd69-4003-aa69-29b8a8d0a5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.384913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e41dbb-bd69-4003-aa69-29b8a8d0a5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.385336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e41dbb-bd69-4003-aa69-29b8a8d0a5a2 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.401375 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e41dbb-bd69-4003-aa69-29b8a8d0a5a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:21.403657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e41dbb-bd69-4003-aa69-29b8a8d0a5a2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:21.423190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-78e41dbb-bd69-4003-aa69-29b8a8d0a5a2 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 24 16:38:21.424624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 377/744] 10.222.0.117 () {56 vars in 1143 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:21.431476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e40c8-3ca3-4cdf-b5ce-311932ab3a1c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.448384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e40c8-3ca3-4cdf-b5ce-311932ab3a1c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.457832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afc641-ef7d-420d-bc32-e8a719d240ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.458613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afc641-ef7d-420d-bc32-e8a719d240ed admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.459266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afc641-ef7d-420d-bc32-e8a719d240ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.459910 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afc641-ef7d-420d-bc32-e8a719d240ed admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.460865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afc641-ef7d-420d-bc32-e8a719d240ed admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:21.461284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afc641-ef7d-420d-bc32-e8a719d240ed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:21.463293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afc641-ef7d-420d-bc32-e8a719d240ed admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:21.493947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 368/745] 10.222.0.117 () {56 vars in 1175 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:21.499516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e41dbb-bd69-4003-aa69-29b8a8d0a5a2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.512580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e41dbb-bd69-4003-aa69-29b8a8d0a5a2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.519951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a298fa6-08d9-4e8a-952c-6c5444247619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.520855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a298fa6-08d9-4e8a-952c-6c5444247619 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.521343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a298fa6-08d9-4e8a-952c-6c5444247619 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.521952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a298fa6-08d9-4e8a-952c-6c5444247619 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.532680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a298fa6-08d9-4e8a-952c-6c5444247619 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:21.534644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a298fa6-08d9-4e8a-952c-6c5444247619 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:21.544108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 378/746] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/auth/tokens => generated 1118 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:38:21.550800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afc641-ef7d-420d-bc32-e8a719d240ed admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.567797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afc641-ef7d-420d-bc32-e8a719d240ed admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.577692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886dc80-4495-43f6-b127-3ef8fd5591df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.578475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886dc80-4495-43f6-b127-3ef8fd5591df admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.578770 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886dc80-4495-43f6-b127-3ef8fd5591df admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.579049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886dc80-4495-43f6-b127-3ef8fd5591df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.596056 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886dc80-4495-43f6-b127-3ef8fd5591df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:21.597884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886dc80-4495-43f6-b127-3ef8fd5591df admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:21.625792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-6886dc80-4495-43f6-b127-3ef8fd5591df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:21.627017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 369/747] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:21.633608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a298fa6-08d9-4e8a-952c-6c5444247619 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.643846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a298fa6-08d9-4e8a-952c-6c5444247619 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.659633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88d95-abe2-4791-bd1b-d1f21007798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.660314 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88d95-abe2-4791-bd1b-d1f21007798f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.660593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88d95-abe2-4791-bd1b-d1f21007798f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.660865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88d95-abe2-4791-bd1b-d1f21007798f admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.661603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b88d95-abe2-4791-bd1b-d1f21007798f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:21.661901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b88d95-abe2-4791-bd1b-d1f21007798f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:21.664202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b88d95-abe2-4791-bd1b-d1f21007798f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:21.680557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 379/748] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:21.686003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886dc80-4495-43f6-b127-3ef8fd5591df admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.700634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886dc80-4495-43f6-b127-3ef8fd5591df admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.710802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898057f1-1d84-467c-a7b9-457c7f681918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.711587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898057f1-1d84-467c-a7b9-457c7f681918 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.711867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898057f1-1d84-467c-a7b9-457c7f681918 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.712141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898057f1-1d84-467c-a7b9-457c7f681918 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.728144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898057f1-1d84-467c-a7b9-457c7f681918 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:21.730120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898057f1-1d84-467c-a7b9-457c7f681918 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:21.746830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-898057f1-1d84-467c-a7b9-457c7f681918 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:21.752580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 370/749] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:21.753989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88d95-abe2-4791-bd1b-d1f21007798f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.767738 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88d95-abe2-4791-bd1b-d1f21007798f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.783687 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448902b4-4984-4ed8-ac8d-8c2266c967e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.784354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448902b4-4984-4ed8-ac8d-8c2266c967e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.784635 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448902b4-4984-4ed8-ac8d-8c2266c967e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.784908 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448902b4-4984-4ed8-ac8d-8c2266c967e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.785733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448902b4-4984-4ed8-ac8d-8c2266c967e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:21.786044 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448902b4-4984-4ed8-ac8d-8c2266c967e9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:21.789076 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448902b4-4984-4ed8-ac8d-8c2266c967e9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:21.804248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 380/750] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:21.809929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898057f1-1d84-467c-a7b9-457c7f681918 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:21.824688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898057f1-1d84-467c-a7b9-457c7f681918 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:21.829258 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb5627-572b-44d4-94a9-edb10313bb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:21.829903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb5627-572b-44d4-94a9-edb10313bb3f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:21.830177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb5627-572b-44d4-94a9-edb10313bb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:21.830440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb5627-572b-44d4-94a9-edb10313bb3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:21.831342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb5627-572b-44d4-94a9-edb10313bb3f admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=3d89f63c0db746008b7d9da99bd30266) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:21.831707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb5627-572b-44d4-94a9-edb10313bb3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:21.833541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb5627-572b-44d4-94a9-edb10313bb3f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:21.846900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 371/751] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:21 2022] GET /identity/v3/role_assignments?user.id=3d89f63c0db746008b7d9da99bd30266&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:22.014318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631967f-1761-4774-a82a-41c00fe3aeec None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.015034 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631967f-1761-4774-a82a-41c00fe3aeec None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.015536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631967f-1761-4774-a82a-41c00fe3aeec None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.017812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 381/752] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:22 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:22.024394 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4d850-4565-4140-a455-393ff14ed46c None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.024953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4d850-4565-4140-a455-393ff14ed46c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.025441 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4d850-4565-4140-a455-393ff14ed46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.044264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-37c4d850-4565-4140-a455-393ff14ed46c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:22.045778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-37c4d850-4565-4140-a455-393ff14ed46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:22.054403 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 372/753] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:22 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:22.078884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631967f-1761-4774-a82a-41c00fe3aeec None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.091577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631967f-1761-4774-a82a-41c00fe3aeec None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.096185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c358e1-8088-42a8-b447-69d7e6b76ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.097235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c358e1-8088-42a8-b447-69d7e6b76ecb admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.097775 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c358e1-8088-42a8-b447-69d7e6b76ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.098273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c358e1-8088-42a8-b447-69d7e6b76ecb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.112140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c358e1-8088-42a8-b447-69d7e6b76ecb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:22.120086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-05c358e1-8088-42a8-b447-69d7e6b76ecb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:38:22.121847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 382/754] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:22.127842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4d850-4565-4140-a455-393ff14ed46c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.155185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4d850-4565-4140-a455-393ff14ed46c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.167394 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e5fa9-de72-4af9-a99d-b82a293e99c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.168065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5fa9-de72-4af9-a99d-b82a293e99c2 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.168342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5fa9-de72-4af9-a99d-b82a293e99c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.168611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5fa9-de72-4af9-a99d-b82a293e99c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.169376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e5fa9-de72-4af9-a99d-b82a293e99c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:22.169676 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e5fa9-de72-4af9-a99d-b82a293e99c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.171287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e5fa9-de72-4af9-a99d-b82a293e99c2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.184994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 373/755] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:22.190597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c358e1-8088-42a8-b447-69d7e6b76ecb admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.207261 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c358e1-8088-42a8-b447-69d7e6b76ecb admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.215088 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935dba9-09dd-4e31-9ef8-225331aea88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.216199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935dba9-09dd-4e31-9ef8-225331aea88e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.216743 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935dba9-09dd-4e31-9ef8-225331aea88e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.217229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935dba9-09dd-4e31-9ef8-225331aea88e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.238407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935dba9-09dd-4e31-9ef8-225331aea88e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.240892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935dba9-09dd-4e31-9ef8-225331aea88e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.263445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-8935dba9-09dd-4e31-9ef8-225331aea88e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:22.265420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 383/756] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:22.271081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e5fa9-de72-4af9-a99d-b82a293e99c2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.288470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e5fa9-de72-4af9-a99d-b82a293e99c2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.299886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9378f24-16d8-4d5e-8be2-4322fe5222ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.300542 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9378f24-16d8-4d5e-8be2-4322fe5222ec admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.300845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9378f24-16d8-4d5e-8be2-4322fe5222ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.301094 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9378f24-16d8-4d5e-8be2-4322fe5222ec admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.301833 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9378f24-16d8-4d5e-8be2-4322fe5222ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:22.302135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9378f24-16d8-4d5e-8be2-4322fe5222ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.304525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9378f24-16d8-4d5e-8be2-4322fe5222ec admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.324128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 374/757] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:22.330365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935dba9-09dd-4e31-9ef8-225331aea88e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.344641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935dba9-09dd-4e31-9ef8-225331aea88e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.352802 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df334e0d-b281-4ba4-982e-51ec690310c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.353966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334e0d-b281-4ba4-982e-51ec690310c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.354466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334e0d-b281-4ba4-982e-51ec690310c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.355065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334e0d-b281-4ba4-982e-51ec690310c6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.367965 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df334e0d-b281-4ba4-982e-51ec690310c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.369986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df334e0d-b281-4ba4-982e-51ec690310c6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.384938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-df334e0d-b281-4ba4-982e-51ec690310c6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 24 16:38:22.386455 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 384/758] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:22.391880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9378f24-16d8-4d5e-8be2-4322fe5222ec admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.407595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9378f24-16d8-4d5e-8be2-4322fe5222ec admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.414884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c369c-3890-47f8-862b-bfa943a622fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.415540 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c369c-3890-47f8-862b-bfa943a622fd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.415820 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c369c-3890-47f8-862b-bfa943a622fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.416092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c369c-3890-47f8-862b-bfa943a622fd admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.416930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c369c-3890-47f8-862b-bfa943a622fd admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:22.417234 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c369c-3890-47f8-862b-bfa943a622fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.419086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c369c-3890-47f8-862b-bfa943a622fd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.452912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 375/759] 10.222.0.117 () {56 vars in 1161 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:22.458867 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df334e0d-b281-4ba4-982e-51ec690310c6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.472296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df334e0d-b281-4ba4-982e-51ec690310c6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.482914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a78b1-654d-46f1-9a1f-ea9b4b0fe82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.483567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a78b1-654d-46f1-9a1f-ea9b4b0fe82d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.483858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a78b1-654d-46f1-9a1f-ea9b4b0fe82d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.484132 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a78b1-654d-46f1-9a1f-ea9b4b0fe82d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.500072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a78b1-654d-46f1-9a1f-ea9b4b0fe82d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.501869 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a78b1-654d-46f1-9a1f-ea9b4b0fe82d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.516764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 385/760] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/auth/tokens => generated 1118 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:38:22.523402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c369c-3890-47f8-862b-bfa943a622fd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.536053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c369c-3890-47f8-862b-bfa943a622fd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.547359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b19ef4-b051-4fb4-b5c5-315439325b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.548140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b19ef4-b051-4fb4-b5c5-315439325b3b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.548421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b19ef4-b051-4fb4-b5c5-315439325b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.548695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b19ef4-b051-4fb4-b5c5-315439325b3b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.562285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b19ef4-b051-4fb4-b5c5-315439325b3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.564117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b19ef4-b051-4fb4-b5c5-315439325b3b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.593305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-a5b19ef4-b051-4fb4-b5c5-315439325b3b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:22.594803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 376/761] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:22.600618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a78b1-654d-46f1-9a1f-ea9b4b0fe82d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.610063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a78b1-654d-46f1-9a1f-ea9b4b0fe82d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.628356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de194fe-9d33-40cf-aaf0-9a3ad3de3fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.629027 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de194fe-9d33-40cf-aaf0-9a3ad3de3fed admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.629311 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de194fe-9d33-40cf-aaf0-9a3ad3de3fed admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.629585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de194fe-9d33-40cf-aaf0-9a3ad3de3fed admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.630330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de194fe-9d33-40cf-aaf0-9a3ad3de3fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:22.630632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de194fe-9d33-40cf-aaf0-9a3ad3de3fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.633103 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de194fe-9d33-40cf-aaf0-9a3ad3de3fed admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.645689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 386/762] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:22.652143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b19ef4-b051-4fb4-b5c5-315439325b3b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.667910 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b19ef4-b051-4fb4-b5c5-315439325b3b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.674727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778951b-5dc0-46ce-adab-1a786c42e65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.675525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778951b-5dc0-46ce-adab-1a786c42e65f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.675802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778951b-5dc0-46ce-adab-1a786c42e65f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.676070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778951b-5dc0-46ce-adab-1a786c42e65f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.687864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778951b-5dc0-46ce-adab-1a786c42e65f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.689811 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778951b-5dc0-46ce-adab-1a786c42e65f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.706099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-7778951b-5dc0-46ce-adab-1a786c42e65f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:22.707598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 377/763] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:22.713769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de194fe-9d33-40cf-aaf0-9a3ad3de3fed admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.728950 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de194fe-9d33-40cf-aaf0-9a3ad3de3fed admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.738072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8888e85-5028-49e0-a30b-c9ab60a6b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.738808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888e85-5028-49e0-a30b-c9ab60a6b287 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.739098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888e85-5028-49e0-a30b-c9ab60a6b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.739373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888e85-5028-49e0-a30b-c9ab60a6b287 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.740203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8888e85-5028-49e0-a30b-c9ab60a6b287 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:22.740609 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8888e85-5028-49e0-a30b-c9ab60a6b287 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.742656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8888e85-5028-49e0-a30b-c9ab60a6b287 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.763884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 387/764] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:22.769963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778951b-5dc0-46ce-adab-1a786c42e65f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.788528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778951b-5dc0-46ce-adab-1a786c42e65f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.798883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cf5d3-380d-4f61-b757-f3a6a44d0a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.799531 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cf5d3-380d-4f61-b757-f3a6a44d0a33 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.799806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cf5d3-380d-4f61-b757-f3a6a44d0a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.800076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cf5d3-380d-4f61-b757-f3a6a44d0a33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.800919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cf5d3-380d-4f61-b757-f3a6a44d0a33 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=6a6d64d2408e481db883823e98f4d831) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:22.801222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cf5d3-380d-4f61-b757-f3a6a44d0a33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.803105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cf5d3-380d-4f61-b757-f3a6a44d0a33 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.815179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 378/765] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/role_assignments?user.id=6a6d64d2408e481db883823e98f4d831&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:22.820919 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915cf7c-a2ca-4031-a936-7b5e2c390288 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.821205 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915cf7c-a2ca-4031-a936-7b5e2c390288 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.821484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915cf7c-a2ca-4031-a936-7b5e2c390288 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.823674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 388/766] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:22.829480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c712e69-ca26-4ccc-b0b2-3ac857ed07b9 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.829814 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c712e69-ca26-4ccc-b0b2-3ac857ed07b9 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.830028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c712e69-ca26-4ccc-b0b2-3ac857ed07b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.848584 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-5c712e69-ca26-4ccc-b0b2-3ac857ed07b9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:22.849846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5c712e69-ca26-4ccc-b0b2-3ac857ed07b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:22.865661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 379/767] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:22 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:22.898325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915cf7c-a2ca-4031-a936-7b5e2c390288 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.912476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915cf7c-a2ca-4031-a936-7b5e2c390288 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.917779 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a3f9e-a31d-47be-97fa-36b9133a1102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.919144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3f9e-a31d-47be-97fa-36b9133a1102 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.919696 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3f9e-a31d-47be-97fa-36b9133a1102 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.920188 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3f9e-a31d-47be-97fa-36b9133a1102 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.921170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a3f9e-a31d-47be-97fa-36b9133a1102 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.923131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a3f9e-a31d-47be-97fa-36b9133a1102 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.937717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-0c1a3f9e-a31d-47be-97fa-36b9133a1102 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 24 16:38:22.939628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 389/768] 10.222.0.117 () {56 vars in 1155 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:22.946501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c712e69-ca26-4ccc-b0b2-3ac857ed07b9 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:22.960202 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c712e69-ca26-4ccc-b0b2-3ac857ed07b9 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:22.971256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341d43f-28d6-4409-92f3-d968fe4caf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:22.971937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341d43f-28d6-4409-92f3-d968fe4caf35 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:22.972212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341d43f-28d6-4409-92f3-d968fe4caf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:22.972484 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341d43f-28d6-4409-92f3-d968fe4caf35 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:22.973212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341d43f-28d6-4409-92f3-d968fe4caf35 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:22.973515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341d43f-28d6-4409-92f3-d968fe4caf35 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:22.975228 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341d43f-28d6-4409-92f3-d968fe4caf35 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:22.983227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 380/769] 10.222.0.117 () {56 vars in 1150 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:22.988880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a3f9e-a31d-47be-97fa-36b9133a1102 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.004305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a3f9e-a31d-47be-97fa-36b9133a1102 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.011812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ea258-86e9-448d-a6b7-4a83716f49da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.012892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ea258-86e9-448d-a6b7-4a83716f49da admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.013390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ea258-86e9-448d-a6b7-4a83716f49da admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.013912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ea258-86e9-448d-a6b7-4a83716f49da admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.014860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ea258-86e9-448d-a6b7-4a83716f49da admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:23.015416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ea258-86e9-448d-a6b7-4a83716f49da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:23.016669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-f11ea258-86e9-448d-a6b7-4a83716f49da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:23.016669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:38:23.016669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:38:23.018011 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ea258-86e9-448d-a6b7-4a83716f49da admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:23.029538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 390/770] 10.222.0.117 () {56 vars in 1150 bytes} [Mon Jan 24 16:38:22 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:23.035433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341d43f-28d6-4409-92f3-d968fe4caf35 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.049331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341d43f-28d6-4409-92f3-d968fe4caf35 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.058894 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734ba27-bf71-4e4a-8eac-4584041313cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.059557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ba27-bf71-4e4a-8eac-4584041313cd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.059837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ba27-bf71-4e4a-8eac-4584041313cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.060114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ba27-bf71-4e4a-8eac-4584041313cd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.060911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734ba27-bf71-4e4a-8eac-4584041313cd admin admin] RBAC: Adding query filter params (interface=public, service_id=f6e1b4ecafb649e98790d935d22f2028, region_id=RegionOne) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:23.061226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734ba27-bf71-4e4a-8eac-4584041313cd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:23.062249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-e734ba27-bf71-4e4a-8eac-4584041313cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:23.062249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:38:23.062249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:38:23.063166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734ba27-bf71-4e4a-8eac-4584041313cd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:23.071737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 381/771] 10.222.0.117 () {56 vars in 1277 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/endpoints?service_id=f6e1b4ecafb649e98790d935d22f2028&interface=public®ion_id=RegionOne => generated 195 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:23.074720 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726fde-de47-4b53-9ff3-579949237955 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.075165 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726fde-de47-4b53-9ff3-579949237955 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.075537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726fde-de47-4b53-9ff3-579949237955 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.077746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734ba27-bf71-4e4a-8eac-4584041313cd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.079026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 391/772] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:23 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:23.087673 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5d93c-158e-4933-b6f3-944e26353026 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.088079 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5d93c-158e-4933-b6f3-944e26353026 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.088513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5d93c-158e-4933-b6f3-944e26353026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.089163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734ba27-bf71-4e4a-8eac-4584041313cd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.096838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc663e-b559-476b-8f6c-6a97d1c68606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.098890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc663e-b559-476b-8f6c-6a97d1c68606 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.099772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc663e-b559-476b-8f6c-6a97d1c68606 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.101624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc663e-b559-476b-8f6c-6a97d1c68606 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.102230 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc663e-b559-476b-8f6c-6a97d1c68606 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:23.104009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc663e-b559-476b-8f6c-6a97d1c68606 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:23.110677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 382/773] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/services => generated 776 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:23.116899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-71c5d93c-158e-4933-b6f3-944e26353026 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:23.118334 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-71c5d93c-158e-4933-b6f3-944e26353026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:23.127256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 392/774] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:23 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:38:23.153064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc663e-b559-476b-8f6c-6a97d1c68606 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.164163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc663e-b559-476b-8f6c-6a97d1c68606 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.169280 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef985b27-21e4-4cb2-aca3-f43aeb75dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.170311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef985b27-21e4-4cb2-aca3-f43aeb75dfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.170731 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef985b27-21e4-4cb2-aca3-f43aeb75dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.171130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef985b27-21e4-4cb2-aca3-f43aeb75dfa9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.171959 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef985b27-21e4-4cb2-aca3-f43aeb75dfa9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:23.173803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef985b27-21e4-4cb2-aca3-f43aeb75dfa9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:23.186476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-ef985b27-21e4-4cb2-aca3-f43aeb75dfa9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 24 16:38:23.188143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 383/775] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/services/network => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:23.194594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5d93c-158e-4933-b6f3-944e26353026 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.204194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5d93c-158e-4933-b6f3-944e26353026 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.209713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325b279-4f33-4736-af44-f988a631210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.210639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325b279-4f33-4736-af44-f988a631210d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.211092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325b279-4f33-4736-af44-f988a631210d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.211467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325b279-4f33-4736-af44-f988a631210d admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.212349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325b279-4f33-4736-af44-f988a631210d admin admin] RBAC: Adding query filter params (name=network) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:23.212754 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325b279-4f33-4736-af44-f988a631210d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:23.214526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325b279-4f33-4736-af44-f988a631210d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:23.220396 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 393/776] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/services?name=network => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:23.227363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef985b27-21e4-4cb2-aca3-f43aeb75dfa9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.238325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef985b27-21e4-4cb2-aca3-f43aeb75dfa9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.243537 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3a25-ca15-4828-8681-84151eac665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.244400 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3a25-ca15-4828-8681-84151eac665b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.244779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3a25-ca15-4828-8681-84151eac665b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.245165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3a25-ca15-4828-8681-84151eac665b admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.246044 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd3a25-ca15-4828-8681-84151eac665b admin admin] RBAC: Adding query filter params (type=network) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:23.246453 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd3a25-ca15-4828-8681-84151eac665b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:23.248429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd3a25-ca15-4828-8681-84151eac665b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:23.254471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 384/777] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/services?type=network => generated 352 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:23.260575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325b279-4f33-4736-af44-f988a631210d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.271005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325b279-4f33-4736-af44-f988a631210d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.276476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b61c69-d614-4cac-8768-c24fee9b2a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.277132 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b61c69-d614-4cac-8768-c24fee9b2a08 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.277456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b61c69-d614-4cac-8768-c24fee9b2a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.277726 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b61c69-d614-4cac-8768-c24fee9b2a08 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.278568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b61c69-d614-4cac-8768-c24fee9b2a08 admin admin] RBAC: Adding query filter params (interface=public, service_id=a39dea1f4c95436986ddaf25e58d7e58, region_id=RegionOne) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:23.278918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b61c69-d614-4cac-8768-c24fee9b2a08 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:23.280087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-f7b61c69-d614-4cac-8768-c24fee9b2a08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:23.280087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:38:23.280087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:38:23.280973 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b61c69-d614-4cac-8768-c24fee9b2a08 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:23.290961 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 394/778] 10.222.0.117 () {56 vars in 1277 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/endpoints?service_id=a39dea1f4c95436986ddaf25e58d7e58&interface=public®ion_id=RegionOne => generated 195 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:23.300197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3a25-ca15-4828-8681-84151eac665b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.314171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3a25-ca15-4828-8681-84151eac665b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.321042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d70f4-bb2a-4f6c-b251-dc55a1ac070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.321825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d70f4-bb2a-4f6c-b251-dc55a1ac070c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.322108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d70f4-bb2a-4f6c-b251-dc55a1ac070c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.322382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d70f4-bb2a-4f6c-b251-dc55a1ac070c admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.323130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d70f4-bb2a-4f6c-b251-dc55a1ac070c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:23.324845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d70f4-bb2a-4f6c-b251-dc55a1ac070c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:23.337271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 385/779] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/services => generated 776 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:23.662402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cbde4-0eba-42e5-aa48-58d7d195fc90 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.663371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cbde4-0eba-42e5-aa48-58d7d195fc90 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.663371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cbde4-0eba-42e5-aa48-58d7d195fc90 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.665551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 395/780] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:23.671157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da1e9-ad6f-4b9d-a024-826f3c580abd None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.671728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da1e9-ad6f-4b9d-a024-826f3c580abd None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.671728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da1e9-ad6f-4b9d-a024-826f3c580abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.695225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-0d6da1e9-ad6f-4b9d-a024-826f3c580abd None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:23.696414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0d6da1e9-ad6f-4b9d-a024-826f3c580abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:23.704544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 386/781] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:23 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:23.744787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cbde4-0eba-42e5-aa48-58d7d195fc90 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.757929 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cbde4-0eba-42e5-aa48-58d7d195fc90 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.762248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101f30c-9b9b-4c28-b04e-3bcb8b95e822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.763048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101f30c-9b9b-4c28-b04e-3bcb8b95e822 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.763324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101f30c-9b9b-4c28-b04e-3bcb8b95e822 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.763583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101f30c-9b9b-4c28-b04e-3bcb8b95e822 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.775345 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101f30c-9b9b-4c28-b04e-3bcb8b95e822 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:23.782184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-e101f30c-9b9b-4c28-b04e-3bcb8b95e822 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:38:23.783749 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 396/782] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:23.789131 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6da1e9-ad6f-4b9d-a024-826f3c580abd None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.804769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6da1e9-ad6f-4b9d-a024-826f3c580abd None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.814888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bce1d4-aa07-4f58-bd66-6c23fad5af10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.815557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bce1d4-aa07-4f58-bd66-6c23fad5af10 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.815841 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bce1d4-aa07-4f58-bd66-6c23fad5af10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.816115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bce1d4-aa07-4f58-bd66-6c23fad5af10 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.816881 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bce1d4-aa07-4f58-bd66-6c23fad5af10 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:23.817190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bce1d4-aa07-4f58-bd66-6c23fad5af10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:23.819680 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bce1d4-aa07-4f58-bd66-6c23fad5af10 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:23.831687 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 387/783] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:23.839108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101f30c-9b9b-4c28-b04e-3bcb8b95e822 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.849015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101f30c-9b9b-4c28-b04e-3bcb8b95e822 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.859657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d032d80-47a1-438a-9d6b-a110443ce362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.860443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032d80-47a1-438a-9d6b-a110443ce362 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.860777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032d80-47a1-438a-9d6b-a110443ce362 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.861053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032d80-47a1-438a-9d6b-a110443ce362 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.877649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d032d80-47a1-438a-9d6b-a110443ce362 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:23.879561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d032d80-47a1-438a-9d6b-a110443ce362 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:23.908843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-8d032d80-47a1-438a-9d6b-a110443ce362 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:23.910207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 397/784] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:23.916518 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bce1d4-aa07-4f58-bd66-6c23fad5af10 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.929454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bce1d4-aa07-4f58-bd66-6c23fad5af10 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.938116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4531690-c255-49e0-9512-5843d6e30c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:23.939190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4531690-c255-49e0-9512-5843d6e30c33 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:23.939601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4531690-c255-49e0-9512-5843d6e30c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:23.940006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4531690-c255-49e0-9512-5843d6e30c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:23.941091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4531690-c255-49e0-9512-5843d6e30c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:23.941558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4531690-c255-49e0-9512-5843d6e30c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:23.944122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4531690-c255-49e0-9512-5843d6e30c33 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:23.970531 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 388/785] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:23.976578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d032d80-47a1-438a-9d6b-a110443ce362 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:23.989777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d032d80-47a1-438a-9d6b-a110443ce362 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:23.999452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc8d4-e8cc-4ad2-9c87-619f7981832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.000285 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc8d4-e8cc-4ad2-9c87-619f7981832d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.000614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc8d4-e8cc-4ad2-9c87-619f7981832d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.000885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc8d4-e8cc-4ad2-9c87-619f7981832d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.009723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dc8d4-e8cc-4ad2-9c87-619f7981832d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:24.011739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dc8d4-e8cc-4ad2-9c87-619f7981832d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:24.029416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-259dc8d4-e8cc-4ad2-9c87-619f7981832d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 24 16:38:24.030585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 398/786] 10.222.0.117 () {56 vars in 1119 bytes} [Mon Jan 24 16:38:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:24.036083 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4531690-c255-49e0-9512-5843d6e30c33 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:24.047972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4531690-c255-49e0-9512-5843d6e30c33 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:24.054477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a0388-bcb5-4fbd-bc66-a93e82bbc85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.055220 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0388-bcb5-4fbd-bc66-a93e82bbc85f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.055501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0388-bcb5-4fbd-bc66-a93e82bbc85f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.055777 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0388-bcb5-4fbd-bc66-a93e82bbc85f admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.056678 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a0388-bcb5-4fbd-bc66-a93e82bbc85f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:24.056987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a0388-bcb5-4fbd-bc66-a93e82bbc85f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:24.058967 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a0388-bcb5-4fbd-bc66-a93e82bbc85f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:24.077398 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 389/787] 10.222.0.117 () {56 vars in 1159 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:24.082524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc8d4-e8cc-4ad2-9c87-619f7981832d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:24.101404 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc8d4-e8cc-4ad2-9c87-619f7981832d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:24.110938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea037-2e62-4e38-9bb6-9cb48fad6723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.111583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea037-2e62-4e38-9bb6-9cb48fad6723 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.111865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea037-2e62-4e38-9bb6-9cb48fad6723 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.112140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea037-2e62-4e38-9bb6-9cb48fad6723 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.127038 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ea037-2e62-4e38-9bb6-9cb48fad6723 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:24.128780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ea037-2e62-4e38-9bb6-9cb48fad6723 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:24.144638 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 399/788] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/auth/tokens => generated 1118 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:38:24.154835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a0388-bcb5-4fbd-bc66-a93e82bbc85f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:24.168252 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a0388-bcb5-4fbd-bc66-a93e82bbc85f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:24.181224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed099d-2294-4c46-aa4a-5cad568b94a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.182025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed099d-2294-4c46-aa4a-5cad568b94a3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.182307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed099d-2294-4c46-aa4a-5cad568b94a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.182584 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed099d-2294-4c46-aa4a-5cad568b94a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.197291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed099d-2294-4c46-aa4a-5cad568b94a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:24.207225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed099d-2294-4c46-aa4a-5cad568b94a3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:24.232995 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-01ed099d-2294-4c46-aa4a-5cad568b94a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:24.234523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 390/789] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:24.240132 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea037-2e62-4e38-9bb6-9cb48fad6723 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:24.255808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea037-2e62-4e38-9bb6-9cb48fad6723 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:24.272800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af765fb-8274-4cb2-8da2-bc44a9335c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.273461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af765fb-8274-4cb2-8da2-bc44a9335c52 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.273819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af765fb-8274-4cb2-8da2-bc44a9335c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.274237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af765fb-8274-4cb2-8da2-bc44a9335c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.275415 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af765fb-8274-4cb2-8da2-bc44a9335c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:24.275873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af765fb-8274-4cb2-8da2-bc44a9335c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:24.278537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af765fb-8274-4cb2-8da2-bc44a9335c52 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:24.305085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 400/790] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:24.310808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed099d-2294-4c46-aa4a-5cad568b94a3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:24.325670 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed099d-2294-4c46-aa4a-5cad568b94a3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:24.337973 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09b1e1-cde8-4d46-97dd-97a7711f39ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.338825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09b1e1-cde8-4d46-97dd-97a7711f39ed admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.339113 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09b1e1-cde8-4d46-97dd-97a7711f39ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.339387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09b1e1-cde8-4d46-97dd-97a7711f39ed admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.357441 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09b1e1-cde8-4d46-97dd-97a7711f39ed admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:24.359503 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09b1e1-cde8-4d46-97dd-97a7711f39ed admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:24.374015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-8d09b1e1-cde8-4d46-97dd-97a7711f39ed admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:24.383656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 391/791] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:24.389384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af765fb-8274-4cb2-8da2-bc44a9335c52 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:24.403827 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af765fb-8274-4cb2-8da2-bc44a9335c52 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:24.416333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8dad1-91e9-49e2-8f7d-a8ef6eec7861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.416990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8dad1-91e9-49e2-8f7d-a8ef6eec7861 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.417272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8dad1-91e9-49e2-8f7d-a8ef6eec7861 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.417544 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8dad1-91e9-49e2-8f7d-a8ef6eec7861 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.418397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8dad1-91e9-49e2-8f7d-a8ef6eec7861 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:24.418655 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8dad1-91e9-49e2-8f7d-a8ef6eec7861 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:24.420517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8dad1-91e9-49e2-8f7d-a8ef6eec7861 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:24.441012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 401/792] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:24.446479 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09b1e1-cde8-4d46-97dd-97a7711f39ed admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:24.463335 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09b1e1-cde8-4d46-97dd-97a7711f39ed admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:24.470877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fc6f8-80f9-490a-8326-06778b533b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.471522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc6f8-80f9-490a-8326-06778b533b5b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.471804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc6f8-80f9-490a-8326-06778b533b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.472077 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc6f8-80f9-490a-8326-06778b533b5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.472920 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fc6f8-80f9-490a-8326-06778b533b5b admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=37c91fefe89a45b48df82a311e771ea3) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:24.473227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fc6f8-80f9-490a-8326-06778b533b5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:24.475667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fc6f8-80f9-490a-8326-06778b533b5b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:24.482154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 392/793] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/role_assignments?user.id=37c91fefe89a45b48df82a311e771ea3&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 610 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:24.719306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab531b2-c4e4-4a79-b8b3-ffaa246a6a77 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.719972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab531b2-c4e4-4a79-b8b3-ffaa246a6a77 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.719972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab531b2-c4e4-4a79-b8b3-ffaa246a6a77 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.721848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 402/794] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:24.727754 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb4f0-36b5-4e47-a360-65a18a9f2914 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.728274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb4f0-36b5-4e47-a360-65a18a9f2914 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.728274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb4f0-36b5-4e47-a360-65a18a9f2914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.749747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-8c0eb4f0-36b5-4e47-a360-65a18a9f2914 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:24.750966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8c0eb4f0-36b5-4e47-a360-65a18a9f2914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:24.759421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 393/795] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:24 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:38:24.784180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab531b2-c4e4-4a79-b8b3-ffaa246a6a77 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:24.800000 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab531b2-c4e4-4a79-b8b3-ffaa246a6a77 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:24.804911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9337afd-ae2c-47a4-8b67-9ed24a3a1fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.805802 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9337afd-ae2c-47a4-8b67-9ed24a3a1fef admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.806079 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9337afd-ae2c-47a4-8b67-9ed24a3a1fef admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.806348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9337afd-ae2c-47a4-8b67-9ed24a3a1fef admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.819686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9337afd-ae2c-47a4-8b67-9ed24a3a1fef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:24.836781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-d9337afd-ae2c-47a4-8b67-9ed24a3a1fef admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:24.838021 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 403/796] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:24.843950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eb4f0-36b5-4e47-a360-65a18a9f2914 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:24.854063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eb4f0-36b5-4e47-a360-65a18a9f2914 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:24.858712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6650c-f0b8-46aa-807a-dc42539203a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.859413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6650c-f0b8-46aa-807a-dc42539203a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.859694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6650c-f0b8-46aa-807a-dc42539203a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.859971 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6650c-f0b8-46aa-807a-dc42539203a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.860852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6650c-f0b8-46aa-807a-dc42539203a1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:24.861165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6650c-f0b8-46aa-807a-dc42539203a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:24.862788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6650c-f0b8-46aa-807a-dc42539203a1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:24.871926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 394/797] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:24.877537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9337afd-ae2c-47a4-8b67-9ed24a3a1fef admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:24.888510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9337afd-ae2c-47a4-8b67-9ed24a3a1fef admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:24.894073 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbe08c-8ca9-4821-b5ba-afa74a7cee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.894951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbe08c-8ca9-4821-b5ba-afa74a7cee97 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.895233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbe08c-8ca9-4821-b5ba-afa74a7cee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.895506 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbe08c-8ca9-4821-b5ba-afa74a7cee97 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.907920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbe08c-8ca9-4821-b5ba-afa74a7cee97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:24.909820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbe08c-8ca9-4821-b5ba-afa74a7cee97 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:24.928972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-46cbe08c-8ca9-4821-b5ba-afa74a7cee97 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:24.930912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 404/798] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:24.936746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6650c-f0b8-46aa-807a-dc42539203a1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:24.953387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6650c-f0b8-46aa-807a-dc42539203a1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:24.958278 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212c8c0-b2f4-491d-b36a-b3315a851524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:24.960005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212c8c0-b2f4-491d-b36a-b3315a851524 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:24.960541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212c8c0-b2f4-491d-b36a-b3315a851524 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:24.961063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212c8c0-b2f4-491d-b36a-b3315a851524 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:24.962017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212c8c0-b2f4-491d-b36a-b3315a851524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:24.962519 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212c8c0-b2f4-491d-b36a-b3315a851524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:24.972363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212c8c0-b2f4-491d-b36a-b3315a851524 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:24.985162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 395/799] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:24.990802 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbe08c-8ca9-4821-b5ba-afa74a7cee97 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.001264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbe08c-8ca9-4821-b5ba-afa74a7cee97 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.006580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade668f5-e01a-4f27-a275-cb3422fd9687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.007747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade668f5-e01a-4f27-a275-cb3422fd9687 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.008228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade668f5-e01a-4f27-a275-cb3422fd9687 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.008912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade668f5-e01a-4f27-a275-cb3422fd9687 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.026392 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade668f5-e01a-4f27-a275-cb3422fd9687 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:25.028769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade668f5-e01a-4f27-a275-cb3422fd9687 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:25.048478 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-ade668f5-e01a-4f27-a275-cb3422fd9687 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 24 16:38:25.050360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 405/800] 10.222.0.117 () {56 vars in 1143 bytes} [Mon Jan 24 16:38:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:25.056267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212c8c0-b2f4-491d-b36a-b3315a851524 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.068790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212c8c0-b2f4-491d-b36a-b3315a851524 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.073627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0177e-aa6e-4127-b089-700e31d72ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.074557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0177e-aa6e-4127-b089-700e31d72ecc admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.075057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0177e-aa6e-4127-b089-700e31d72ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.075550 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0177e-aa6e-4127-b089-700e31d72ecc admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.076618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0177e-aa6e-4127-b089-700e31d72ecc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:25.077172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0177e-aa6e-4127-b089-700e31d72ecc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:25.079314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0177e-aa6e-4127-b089-700e31d72ecc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:25.105106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 396/801] 10.222.0.117 () {56 vars in 1175 bytes} [Mon Jan 24 16:38:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:25.110474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade668f5-e01a-4f27-a275-cb3422fd9687 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.123357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade668f5-e01a-4f27-a275-cb3422fd9687 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.128298 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda80565-6088-43e2-8a49-db496358e234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.129358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80565-6088-43e2-8a49-db496358e234 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.129920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80565-6088-43e2-8a49-db496358e234 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.130391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80565-6088-43e2-8a49-db496358e234 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.156771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda80565-6088-43e2-8a49-db496358e234 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:25.164339 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda80565-6088-43e2-8a49-db496358e234 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:25.188326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-cda80565-6088-43e2-8a49-db496358e234 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:25.189813 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 406/802] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:25.195976 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0177e-aa6e-4127-b089-700e31d72ecc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.210912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0177e-aa6e-4127-b089-700e31d72ecc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.218420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dfa16-f5f0-4329-9434-a5c179eeefb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.219264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dfa16-f5f0-4329-9434-a5c179eeefb5 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.219787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dfa16-f5f0-4329-9434-a5c179eeefb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.220199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dfa16-f5f0-4329-9434-a5c179eeefb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.221224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dfa16-f5f0-4329-9434-a5c179eeefb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:25.221669 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dfa16-f5f0-4329-9434-a5c179eeefb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:25.223692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dfa16-f5f0-4329-9434-a5c179eeefb5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:25.245413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 397/803] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:25.250778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda80565-6088-43e2-8a49-db496358e234 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.269684 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda80565-6088-43e2-8a49-db496358e234 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.279626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0ad1e-8f50-4c11-b303-f571db602cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.280446 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0ad1e-8f50-4c11-b303-f571db602cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.280723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0ad1e-8f50-4c11-b303-f571db602cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.280991 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0ad1e-8f50-4c11-b303-f571db602cf6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.289281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0ad1e-8f50-4c11-b303-f571db602cf6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:25.291270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0ad1e-8f50-4c11-b303-f571db602cf6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:25.313603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-d9a0ad1e-8f50-4c11-b303-f571db602cf6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:25.315077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 407/804] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:25.320838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dfa16-f5f0-4329-9434-a5c179eeefb5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.338917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dfa16-f5f0-4329-9434-a5c179eeefb5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.343977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7774cfd-77e9-4d53-a477-212dd1426fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.344961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774cfd-77e9-4d53-a477-212dd1426fcb admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.345440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774cfd-77e9-4d53-a477-212dd1426fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.345929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774cfd-77e9-4d53-a477-212dd1426fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.346984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7774cfd-77e9-4d53-a477-212dd1426fcb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:25.347506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7774cfd-77e9-4d53-a477-212dd1426fcb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:25.349665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7774cfd-77e9-4d53-a477-212dd1426fcb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:25.371838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 398/805] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:25.377670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0ad1e-8f50-4c11-b303-f571db602cf6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.391696 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0ad1e-8f50-4c11-b303-f571db602cf6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.402036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab6a11-e4f8-4fa5-a36f-e45d8ca2cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.402932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab6a11-e4f8-4fa5-a36f-e45d8ca2cabb admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.403213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab6a11-e4f8-4fa5-a36f-e45d8ca2cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.403484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab6a11-e4f8-4fa5-a36f-e45d8ca2cabb admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/3d89f63c0db746008b7d9da99bd30266/roles/adcc0add18bc4deebfb1e1785ed0297b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.425655 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab6a11-e4f8-4fa5-a36f-e45d8ca2cabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=3d89f63c0db746008b7d9da99bd30266, role_id=adcc0add18bc4deebfb1e1785ed0297b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:25.428997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab6a11-e4f8-4fa5-a36f-e45d8ca2cabb admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:25.453023 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 408/806] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:38:25 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/3d89f63c0db746008b7d9da99bd30266/roles/adcc0add18bc4deebfb1e1785ed0297b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:38:25.578786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415efdd-42c5-426d-8c24-d8b41df5ea9b None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.579125 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415efdd-42c5-426d-8c24-d8b41df5ea9b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.579339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415efdd-42c5-426d-8c24-d8b41df5ea9b None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.581400 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 399/807] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:25.587046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c2be5-8111-4630-b500-66096dc1a6c8 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.587337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c2be5-8111-4630-b500-66096dc1a6c8 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.587609 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c2be5-8111-4630-b500-66096dc1a6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.611902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-3b8c2be5-8111-4630-b500-66096dc1a6c8 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:25.613110 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3b8c2be5-8111-4630-b500-66096dc1a6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:25.683983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 409/808] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:25 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:25.712829 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415efdd-42c5-426d-8c24-d8b41df5ea9b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.729573 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415efdd-42c5-426d-8c24-d8b41df5ea9b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.737259 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2effca-9d70-4119-bffe-ffc2dbcac45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.738400 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2effca-9d70-4119-bffe-ffc2dbcac45a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.738957 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2effca-9d70-4119-bffe-ffc2dbcac45a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.739429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2effca-9d70-4119-bffe-ffc2dbcac45a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.763767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2effca-9d70-4119-bffe-ffc2dbcac45a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:25.771096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-ff2effca-9d70-4119-bffe-ffc2dbcac45a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:38:25.773452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 400/809] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:25.779573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c2be5-8111-4630-b500-66096dc1a6c8 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.790683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c2be5-8111-4630-b500-66096dc1a6c8 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.796585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534460c8-a3cb-459e-9973-398218905e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.797711 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534460c8-a3cb-459e-9973-398218905e2a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.798249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534460c8-a3cb-459e-9973-398218905e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.798848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534460c8-a3cb-459e-9973-398218905e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.799888 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534460c8-a3cb-459e-9973-398218905e2a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:25.800488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534460c8-a3cb-459e-9973-398218905e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:25.802452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534460c8-a3cb-459e-9973-398218905e2a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:25.819969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 410/810] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:25.826149 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2effca-9d70-4119-bffe-ffc2dbcac45a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.838581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2effca-9d70-4119-bffe-ffc2dbcac45a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.845429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3bf6c-08f8-4b29-8a80-efe1e5164589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.846541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3bf6c-08f8-4b29-8a80-efe1e5164589 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.847044 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3bf6c-08f8-4b29-8a80-efe1e5164589 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.847583 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3bf6c-08f8-4b29-8a80-efe1e5164589 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.864691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3bf6c-08f8-4b29-8a80-efe1e5164589 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:25.866975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3bf6c-08f8-4b29-8a80-efe1e5164589 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:25.890144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-82a3bf6c-08f8-4b29-8a80-efe1e5164589 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:25.891739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 401/811] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:25.898201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534460c8-a3cb-459e-9973-398218905e2a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.914407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534460c8-a3cb-459e-9973-398218905e2a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.919257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488300aa-ed55-4b2f-869e-bfa615af2e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.920178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488300aa-ed55-4b2f-869e-bfa615af2e5e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.920708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488300aa-ed55-4b2f-869e-bfa615af2e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.921250 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488300aa-ed55-4b2f-869e-bfa615af2e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.922176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488300aa-ed55-4b2f-869e-bfa615af2e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:25.922687 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488300aa-ed55-4b2f-869e-bfa615af2e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:25.924645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488300aa-ed55-4b2f-869e-bfa615af2e5e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:25.942996 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 411/812] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:25.949382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3bf6c-08f8-4b29-8a80-efe1e5164589 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:25.960120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3bf6c-08f8-4b29-8a80-efe1e5164589 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:25.970524 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfcbe-10f9-4afb-8713-068e6d443eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:25.971651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfcbe-10f9-4afb-8713-068e6d443eef admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:25.972256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfcbe-10f9-4afb-8713-068e6d443eef admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:25.972745 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfcbe-10f9-4afb-8713-068e6d443eef admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:25.981946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcfcbe-10f9-4afb-8713-068e6d443eef admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:25.984297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcfcbe-10f9-4afb-8713-068e6d443eef admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:25.998649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-80fcfcbe-10f9-4afb-8713-068e6d443eef admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 24 16:38:26.000447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 402/813] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:26.008139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488300aa-ed55-4b2f-869e-bfa615af2e5e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.024361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488300aa-ed55-4b2f-869e-bfa615af2e5e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.035220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f3b42-b410-4f72-8000-fac716c931da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.035913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f3b42-b410-4f72-8000-fac716c931da admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.036191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f3b42-b410-4f72-8000-fac716c931da admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.036463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f3b42-b410-4f72-8000-fac716c931da admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.038293 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f3b42-b410-4f72-8000-fac716c931da admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:26.038776 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f3b42-b410-4f72-8000-fac716c931da admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.040671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f3b42-b410-4f72-8000-fac716c931da admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.070593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 412/814] 10.222.0.117 () {56 vars in 1161 bytes} [Mon Jan 24 16:38:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:26.078793 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfcbe-10f9-4afb-8713-068e6d443eef admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.092862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfcbe-10f9-4afb-8713-068e6d443eef admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.109328 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d963d2a-9369-472a-9111-7ffac00fcb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.110121 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963d2a-9369-472a-9111-7ffac00fcb86 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.110402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963d2a-9369-472a-9111-7ffac00fcb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.110675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963d2a-9369-472a-9111-7ffac00fcb86 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.130910 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d963d2a-9369-472a-9111-7ffac00fcb86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.134778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d963d2a-9369-472a-9111-7ffac00fcb86 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.158782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-9d963d2a-9369-472a-9111-7ffac00fcb86 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:26.163373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 403/815] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:26.170406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f3b42-b410-4f72-8000-fac716c931da admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.193153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f3b42-b410-4f72-8000-fac716c931da admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.204922 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c09248-1f6f-44ea-a25e-22b0601844b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.205583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c09248-1f6f-44ea-a25e-22b0601844b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.205862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c09248-1f6f-44ea-a25e-22b0601844b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.206133 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c09248-1f6f-44ea-a25e-22b0601844b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.206904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c09248-1f6f-44ea-a25e-22b0601844b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:26.207199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c09248-1f6f-44ea-a25e-22b0601844b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.209347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c09248-1f6f-44ea-a25e-22b0601844b6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.218385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24f9f-1861-4ac2-a24e-a99eaa5fbcb9 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.218673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24f9f-1861-4ac2-a24e-a99eaa5fbcb9 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.218970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24f9f-1861-4ac2-a24e-a99eaa5fbcb9 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.221029 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 404/816] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:26.227415 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36224-c355-4925-a7d5-bd3b6743d156 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.227698 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36224-c355-4925-a7d5-bd3b6743d156 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.228141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36224-c355-4925-a7d5-bd3b6743d156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.228261 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 413/817] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:26.236575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c09248-1f6f-44ea-a25e-22b0601844b6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.251391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c09248-1f6f-44ea-a25e-22b0601844b6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.258846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-31c36224-c355-4925-a7d5-bd3b6743d156 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:26.260021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-31c36224-c355-4925-a7d5-bd3b6743d156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:26.261380 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42079581-dc67-44c2-9965-65dc3f54cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.262481 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42079581-dc67-44c2-9965-65dc3f54cb25 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.262999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42079581-dc67-44c2-9965-65dc3f54cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.263495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42079581-dc67-44c2-9965-65dc3f54cb25 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.276587 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42079581-dc67-44c2-9965-65dc3f54cb25 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.280164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42079581-dc67-44c2-9965-65dc3f54cb25 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.281327 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 405/818] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:26 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:26.310154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36224-c355-4925-a7d5-bd3b6743d156 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.310490 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-42079581-dc67-44c2-9965-65dc3f54cb25 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:26.311968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 414/819] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:26.320700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42079581-dc67-44c2-9965-65dc3f54cb25 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.324136 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36224-c355-4925-a7d5-bd3b6743d156 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.328851 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22906e-0ed6-4861-bf40-62d32a09bc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.329910 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22906e-0ed6-4861-bf40-62d32a09bc72 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.330392 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22906e-0ed6-4861-bf40-62d32a09bc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.330902 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22906e-0ed6-4861-bf40-62d32a09bc72 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.331771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22906e-0ed6-4861-bf40-62d32a09bc72 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.333698 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22906e-0ed6-4861-bf40-62d32a09bc72 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.343639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42079581-dc67-44c2-9965-65dc3f54cb25 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.346978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-7e22906e-0ed6-4861-bf40-62d32a09bc72 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 24 16:38:26.348662 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82889b38-8648-4049-ba7a-84787e5d5321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.349056 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 406/820] 10.222.0.117 () {56 vars in 1155 bytes} [Mon Jan 24 16:38:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:26.350670 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2052-a5bf-4767-a267-9c20dbd88236 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.351001 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889b38-8648-4049-ba7a-84787e5d5321 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.351295 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889b38-8648-4049-ba7a-84787e5d5321 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.351572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889b38-8648-4049-ba7a-84787e5d5321 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.352081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2052-a5bf-4767-a267-9c20dbd88236 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.352561 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2052-a5bf-4767-a267-9c20dbd88236 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.352671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82889b38-8648-4049-ba7a-84787e5d5321 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:26.352980 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82889b38-8648-4049-ba7a-84787e5d5321 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.355026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82889b38-8648-4049-ba7a-84787e5d5321 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.355246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 407/821] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:26 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:26.362839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e2052-a5bf-4767-a267-9c20dbd88236 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.374825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 415/822] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:26.376428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c12e-26a5-4ef6-ae10-57cf7b835bae None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.377965 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c12e-26a5-4ef6-ae10-57cf7b835bae None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.379138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c12e-26a5-4ef6-ae10-57cf7b835bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.383471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e2052-a5bf-4767-a267-9c20dbd88236 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.388393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fffda-185b-483d-8993-91d8174e2c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.389318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fffda-185b-483d-8993-91d8174e2c09 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.389765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fffda-185b-483d-8993-91d8174e2c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.390236 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fffda-185b-483d-8993-91d8174e2c09 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.391240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fffda-185b-483d-8993-91d8174e2c09 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:26.391737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fffda-185b-483d-8993-91d8174e2c09 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.393596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fffda-185b-483d-8993-91d8174e2c09 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.403576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 408/823] 10.222.0.117 () {56 vars in 1150 bytes} [Mon Jan 24 16:38:26 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:26.403576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fffda-185b-483d-8993-91d8174e2c09 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.404826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d290c12e-26a5-4ef6-ae10-57cf7b835bae None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:26.406390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d290c12e-26a5-4ef6-ae10-57cf7b835bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:26.410928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fffda-185b-483d-8993-91d8174e2c09 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.416657 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0e449-a091-4f98-a5af-09044bd18e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.416843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 416/824] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:26 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:26.417767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290c12e-26a5-4ef6-ae10-57cf7b835bae None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.423644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0e449-a091-4f98-a5af-09044bd18e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.423927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0e449-a091-4f98-a5af-09044bd18e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.424260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0e449-a091-4f98-a5af-09044bd18e6a admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/6a6d64d2408e481db883823e98f4d831/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.427814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290c12e-26a5-4ef6-ae10-57cf7b835bae None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.427981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0e449-a091-4f98-a5af-09044bd18e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=6a6d64d2408e481db883823e98f4d831, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.430853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0e449-a091-4f98-a5af-09044bd18e6a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.433203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707c3bd-4ef6-45fc-8d52-c509419a18f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.434245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c3bd-4ef6-45fc-8d52-c509419a18f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.434728 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c3bd-4ef6-45fc-8d52-c509419a18f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.435261 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c3bd-4ef6-45fc-8d52-c509419a18f7 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.436184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707c3bd-4ef6-45fc-8d52-c509419a18f7 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:26.436695 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707c3bd-4ef6-45fc-8d52-c509419a18f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.438461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707c3bd-4ef6-45fc-8d52-c509419a18f7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.445904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 417/825] 10.222.0.117 () {56 vars in 1150 bytes} [Mon Jan 24 16:38:26 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:26.451849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707c3bd-4ef6-45fc-8d52-c509419a18f7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.457209 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 409/826] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:38:26 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/6a6d64d2408e481db883823e98f4d831/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:38:26.461371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0e449-a091-4f98-a5af-09044bd18e6a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.464126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707c3bd-4ef6-45fc-8d52-c509419a18f7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.556130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0e449-a091-4f98-a5af-09044bd18e6a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.570589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabd17e-a9b7-40dd-af82-453b5ec9ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.572667 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4098ab-eb2e-4031-b862-e92f1456869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.573450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabd17e-a9b7-40dd-af82-453b5ec9ba55 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.573941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabd17e-a9b7-40dd-af82-453b5ec9ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.574881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4098ab-eb2e-4031-b862-e92f1456869e admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.575396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabd17e-a9b7-40dd-af82-453b5ec9ba55 admin admin] PATH_INFO: `/v3/services/network` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.576347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabd17e-a9b7-40dd-af82-453b5ec9ba55 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.576882 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4098ab-eb2e-4031-b862-e92f1456869e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.577434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4098ab-eb2e-4031-b862-e92f1456869e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.579552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4098ab-eb2e-4031-b862-e92f1456869e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.581915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-4d4098ab-eb2e-4031-b862-e92f1456869e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:26.581915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:38:26.581915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:38:26.582433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabd17e-a9b7-40dd-af82-453b5ec9ba55 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.586559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4098ab-eb2e-4031-b862-e92f1456869e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.612836 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-1cabd17e-a9b7-40dd-af82-453b5ec9ba55 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 24 16:38:26.616443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 410/827] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:26 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:26.623712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabd17e-a9b7-40dd-af82-453b5ec9ba55 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.635232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 418/828] 10.222.0.117 () {60 vars in 1170 bytes} [Mon Jan 24 16:38:26 2022] POST /identity/v3/endpoints => generated 348 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:38:26.642625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabd17e-a9b7-40dd-af82-453b5ec9ba55 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.669549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e9ac5-fd6d-41d8-8e9b-275fcc402fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.670636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e9ac5-fd6d-41d8-8e9b-275fcc402fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.671236 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e9ac5-fd6d-41d8-8e9b-275fcc402fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.671734 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e9ac5-fd6d-41d8-8e9b-275fcc402fd0 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.672682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e9ac5-fd6d-41d8-8e9b-275fcc402fd0 admin admin] RBAC: Adding query filter params (name=network) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:26.673199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e9ac5-fd6d-41d8-8e9b-275fcc402fd0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.675188 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e9ac5-fd6d-41d8-8e9b-275fcc402fd0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.682265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 411/829] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:26 2022] GET /identity/v3/services?name=network => generated 125 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:26.687704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4098ab-eb2e-4031-b862-e92f1456869e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.703823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4098ab-eb2e-4031-b862-e92f1456869e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.709706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a83a39-4947-4315-bf5a-aa8571db8f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.710941 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a83a39-4947-4315-bf5a-aa8571db8f67 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.711490 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a83a39-4947-4315-bf5a-aa8571db8f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.711975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a83a39-4947-4315-bf5a-aa8571db8f67 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.713021 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a83a39-4947-4315-bf5a-aa8571db8f67 admin admin] RBAC: Adding query filter params (type=network) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:26.713543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a83a39-4947-4315-bf5a-aa8571db8f67 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.715564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a83a39-4947-4315-bf5a-aa8571db8f67 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.722072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 419/830] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:26 2022] GET /identity/v3/services?type=network => generated 352 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:26.727835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e9ac5-fd6d-41d8-8e9b-275fcc402fd0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:26.743295 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e9ac5-fd6d-41d8-8e9b-275fcc402fd0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:26.748994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010931e4-a4c3-4977-86dd-919046206297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:26.750010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010931e4-a4c3-4977-86dd-919046206297 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:26.750513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010931e4-a4c3-4977-86dd-919046206297 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:26.751032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010931e4-a4c3-4977-86dd-919046206297 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:26.752137 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010931e4-a4c3-4977-86dd-919046206297 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:26.753431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-010931e4-a4c3-4977-86dd-919046206297 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:38:26.753431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:38:26.753431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:38:26.754768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010931e4-a4c3-4977-86dd-919046206297 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:26.779950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 412/831] 10.222.0.117 () {60 vars in 1170 bytes} [Mon Jan 24 16:38:26 2022] POST /identity/v3/endpoints => generated 329 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:27.452980 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c089c5-4bee-4677-9772-46b725e01c21 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:27.453480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c089c5-4bee-4677-9772-46b725e01c21 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:27.453480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c089c5-4bee-4677-9772-46b725e01c21 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:27.455529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 420/832] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:27.461447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b52a9-4790-4e80-a703-1f4531837281 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:27.461739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b52a9-4790-4e80-a703-1f4531837281 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:27.462016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b52a9-4790-4e80-a703-1f4531837281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:27.481199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-fe2b52a9-4790-4e80-a703-1f4531837281 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:27.482372 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-fe2b52a9-4790-4e80-a703-1f4531837281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:27.499392 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 413/833] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:27 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:27.522610 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c089c5-4bee-4677-9772-46b725e01c21 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:27.535149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c089c5-4bee-4677-9772-46b725e01c21 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:27.540199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29277dea-9cf2-462c-a0da-411113f8b274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:27.540993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277dea-9cf2-462c-a0da-411113f8b274 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:27.541269 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277dea-9cf2-462c-a0da-411113f8b274 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:27.541539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277dea-9cf2-462c-a0da-411113f8b274 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:27.542198 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29277dea-9cf2-462c-a0da-411113f8b274 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:27.543797 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29277dea-9cf2-462c-a0da-411113f8b274 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:27.555524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-29277dea-9cf2-462c-a0da-411113f8b274 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 24 16:38:27.557015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 421/834] 10.222.0.117 () {56 vars in 1158 bytes} [Mon Jan 24 16:38:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:27.562608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b52a9-4790-4e80-a703-1f4531837281 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:27.572141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b52a9-4790-4e80-a703-1f4531837281 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:27.576987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd285c-a7d1-4fc4-a79b-4c3762a1668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:27.577644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd285c-a7d1-4fc4-a79b-4c3762a1668c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:27.577928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd285c-a7d1-4fc4-a79b-4c3762a1668c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:27.578207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd285c-a7d1-4fc4-a79b-4c3762a1668c admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:27.578971 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd285c-a7d1-4fc4-a79b-4c3762a1668c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:27.579282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd285c-a7d1-4fc4-a79b-4c3762a1668c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:27.580903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd285c-a7d1-4fc4-a79b-4c3762a1668c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:27.590485 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 414/835] 10.222.0.117 () {56 vars in 1152 bytes} [Mon Jan 24 16:38:27 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:27.592393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29277dea-9cf2-462c-a0da-411113f8b274 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:27.605102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29277dea-9cf2-462c-a0da-411113f8b274 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:27.610089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccd4e6-e8ab-4804-ba14-b99150c5a876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:27.611006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccd4e6-e8ab-4804-ba14-b99150c5a876 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:27.611485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccd4e6-e8ab-4804-ba14-b99150c5a876 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:27.611907 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccd4e6-e8ab-4804-ba14-b99150c5a876 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:27.612837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccd4e6-e8ab-4804-ba14-b99150c5a876 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:27.613297 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccd4e6-e8ab-4804-ba14-b99150c5a876 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:27.615139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccd4e6-e8ab-4804-ba14-b99150c5a876 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:27.620434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 422/836] 10.222.0.117 () {56 vars in 1152 bytes} [Mon Jan 24 16:38:27 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:28.050171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbeec04-be73-46c6-9bf9-caeda19118ea None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.050721 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbeec04-be73-46c6-9bf9-caeda19118ea None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.051046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbeec04-be73-46c6-9bf9-caeda19118ea None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.053800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 415/837] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:28 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:28.059380 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5af07-61aa-46fb-8786-e5dd772f8917 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.059786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5af07-61aa-46fb-8786-e5dd772f8917 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.060166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5af07-61aa-46fb-8786-e5dd772f8917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.079556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-56f5af07-61aa-46fb-8786-e5dd772f8917 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:28.080900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-56f5af07-61aa-46fb-8786-e5dd772f8917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:28.089201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 423/838] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:28 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:28.113287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbeec04-be73-46c6-9bf9-caeda19118ea None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.126311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbeec04-be73-46c6-9bf9-caeda19118ea None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.130990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397beca-029e-45c9-9b18-b5969db581bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.131771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397beca-029e-45c9-9b18-b5969db581bc admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.132152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397beca-029e-45c9-9b18-b5969db581bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.132527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397beca-029e-45c9-9b18-b5969db581bc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.142990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397beca-029e-45c9-9b18-b5969db581bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:28.150020 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-6397beca-029e-45c9-9b18-b5969db581bc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:38:28.151727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 416/839] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:28.157423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5af07-61aa-46fb-8786-e5dd772f8917 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.167323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5af07-61aa-46fb-8786-e5dd772f8917 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.171960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1490d57-a97f-466e-b1a2-b6133de8f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.172710 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1490d57-a97f-466e-b1a2-b6133de8f167 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.173098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1490d57-a97f-466e-b1a2-b6133de8f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.173478 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1490d57-a97f-466e-b1a2-b6133de8f167 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.174331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1490d57-a97f-466e-b1a2-b6133de8f167 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:28.174739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1490d57-a97f-466e-b1a2-b6133de8f167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:28.176438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1490d57-a97f-466e-b1a2-b6133de8f167 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:28.185638 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 424/840] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:28.190970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397beca-029e-45c9-9b18-b5969db581bc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.201461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397beca-029e-45c9-9b18-b5969db581bc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.206015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5023b0-f1ca-4382-962a-d3aa372843e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.206926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5023b0-f1ca-4382-962a-d3aa372843e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.207305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5023b0-f1ca-4382-962a-d3aa372843e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.207680 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5023b0-f1ca-4382-962a-d3aa372843e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.218466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5023b0-f1ca-4382-962a-d3aa372843e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:28.220495 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5023b0-f1ca-4382-962a-d3aa372843e7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:28.237965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-8a5023b0-f1ca-4382-962a-d3aa372843e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:28.239533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 417/841] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:28.244895 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1490d57-a97f-466e-b1a2-b6133de8f167 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.254972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1490d57-a97f-466e-b1a2-b6133de8f167 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.260358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc491a89-f78f-45bb-9f95-62a09287d5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.261161 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc491a89-f78f-45bb-9f95-62a09287d5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.261543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc491a89-f78f-45bb-9f95-62a09287d5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.261917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc491a89-f78f-45bb-9f95-62a09287d5c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.262845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc491a89-f78f-45bb-9f95-62a09287d5c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:28.263250 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc491a89-f78f-45bb-9f95-62a09287d5c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:28.264996 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc491a89-f78f-45bb-9f95-62a09287d5c7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:28.278059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 425/842] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:28.283386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5023b0-f1ca-4382-962a-d3aa372843e7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.294217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5023b0-f1ca-4382-962a-d3aa372843e7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.298997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56b8b9-a51d-4e59-92bd-5219de4b079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.299839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56b8b9-a51d-4e59-92bd-5219de4b079e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.300112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56b8b9-a51d-4e59-92bd-5219de4b079e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.300431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56b8b9-a51d-4e59-92bd-5219de4b079e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.308253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56b8b9-a51d-4e59-92bd-5219de4b079e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:28.310296 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56b8b9-a51d-4e59-92bd-5219de4b079e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:28.324628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-7e56b8b9-a51d-4e59-92bd-5219de4b079e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 24 16:38:28.326074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 418/843] 10.222.0.117 () {56 vars in 1143 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:28.331761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc491a89-f78f-45bb-9f95-62a09287d5c7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.343048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc491a89-f78f-45bb-9f95-62a09287d5c7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.347825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e899ac3-9ee3-44a5-b6b2-c71083d542ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.348528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e899ac3-9ee3-44a5-b6b2-c71083d542ae admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.348805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e899ac3-9ee3-44a5-b6b2-c71083d542ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.349074 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e899ac3-9ee3-44a5-b6b2-c71083d542ae admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.350585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e899ac3-9ee3-44a5-b6b2-c71083d542ae admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:28.350965 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e899ac3-9ee3-44a5-b6b2-c71083d542ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:28.353220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e899ac3-9ee3-44a5-b6b2-c71083d542ae admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:28.371493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 426/844] 10.222.0.117 () {56 vars in 1175 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:28.376994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56b8b9-a51d-4e59-92bd-5219de4b079e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.386979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56b8b9-a51d-4e59-92bd-5219de4b079e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.391585 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4d068-1553-49b3-9ce3-2b9321e29858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.392274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d068-1553-49b3-9ce3-2b9321e29858 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.392552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d068-1553-49b3-9ce3-2b9321e29858 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.392823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d068-1553-49b3-9ce3-2b9321e29858 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.401730 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4d068-1553-49b3-9ce3-2b9321e29858 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:28.403605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4d068-1553-49b3-9ce3-2b9321e29858 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:28.413612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 419/845] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/auth/tokens => generated 1455 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:38:28.419090 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e899ac3-9ee3-44a5-b6b2-c71083d542ae admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.430346 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e899ac3-9ee3-44a5-b6b2-c71083d542ae admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.437319 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c65c1-29e5-44ff-b4ec-6a7a9d943ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.438399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c65c1-29e5-44ff-b4ec-6a7a9d943ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.438885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c65c1-29e5-44ff-b4ec-6a7a9d943ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.439382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c65c1-29e5-44ff-b4ec-6a7a9d943ed8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.451112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c65c1-29e5-44ff-b4ec-6a7a9d943ed8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:28.453200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c65c1-29e5-44ff-b4ec-6a7a9d943ed8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:28.471153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-4b1c65c1-29e5-44ff-b4ec-6a7a9d943ed8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:28.472902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 427/846] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:28.478771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4d068-1553-49b3-9ce3-2b9321e29858 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.487921 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4d068-1553-49b3-9ce3-2b9321e29858 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.493412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa0931-fa2f-4e06-80ac-eca7fa17ced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.494271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa0931-fa2f-4e06-80ac-eca7fa17ced8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.494721 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa0931-fa2f-4e06-80ac-eca7fa17ced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.495184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa0931-fa2f-4e06-80ac-eca7fa17ced8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.496162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa0931-fa2f-4e06-80ac-eca7fa17ced8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:28.496694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa0931-fa2f-4e06-80ac-eca7fa17ced8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:28.498439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa0931-fa2f-4e06-80ac-eca7fa17ced8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:28.512053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 420/847] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:28.517675 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c65c1-29e5-44ff-b4ec-6a7a9d943ed8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.528224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c65c1-29e5-44ff-b4ec-6a7a9d943ed8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.533125 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac6212-796b-424c-9cc1-1e7cd57f6cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.534177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac6212-796b-424c-9cc1-1e7cd57f6cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.534630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac6212-796b-424c-9cc1-1e7cd57f6cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.535098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac6212-796b-424c-9cc1-1e7cd57f6cb2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.543585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac6212-796b-424c-9cc1-1e7cd57f6cb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:28.545790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac6212-796b-424c-9cc1-1e7cd57f6cb2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:28.559945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-edac6212-796b-424c-9cc1-1e7cd57f6cb2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:28.561650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 428/848] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:28.567420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa0931-fa2f-4e06-80ac-eca7fa17ced8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.578320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa0931-fa2f-4e06-80ac-eca7fa17ced8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.583127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5ee1f-0a50-4704-a296-25dce0ee77af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.584117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5ee1f-0a50-4704-a296-25dce0ee77af admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.584591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5ee1f-0a50-4704-a296-25dce0ee77af admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.585050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5ee1f-0a50-4704-a296-25dce0ee77af admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.586091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5ee1f-0a50-4704-a296-25dce0ee77af admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:28.586568 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5ee1f-0a50-4704-a296-25dce0ee77af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:28.588667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5ee1f-0a50-4704-a296-25dce0ee77af admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:28.603930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 421/849] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:28.609977 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac6212-796b-424c-9cc1-1e7cd57f6cb2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:28.621892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac6212-796b-424c-9cc1-1e7cd57f6cb2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:28.626810 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe140a-e653-4a03-ab3b-9e3dda955261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:28.627681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe140a-e653-4a03-ab3b-9e3dda955261 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.628149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe140a-e653-4a03-ab3b-9e3dda955261 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.628637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe140a-e653-4a03-ab3b-9e3dda955261 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.629646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe140a-e653-4a03-ab3b-9e3dda955261 admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=3d89f63c0db746008b7d9da99bd30266) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:28.630168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe140a-e653-4a03-ab3b-9e3dda955261 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:28.632593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe140a-e653-4a03-ab3b-9e3dda955261 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:28.639281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 429/850] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:28 2022] GET /identity/v3/role_assignments?user.id=3d89f63c0db746008b7d9da99bd30266&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 610 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:28.965966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fbe70-421f-436d-a108-cea50783aa38 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.966161 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fbe70-421f-436d-a108-cea50783aa38 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.966420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fbe70-421f-436d-a108-cea50783aa38 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.968618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 422/851] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:28.974717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2192c9-41f0-47a1-a3d3-d8b22cb06e0e None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:28.975101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2192c9-41f0-47a1-a3d3-d8b22cb06e0e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:28.975302 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2192c9-41f0-47a1-a3d3-d8b22cb06e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:28.994438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-3a2192c9-41f0-47a1-a3d3-d8b22cb06e0e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:28.995634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3a2192c9-41f0-47a1-a3d3-d8b22cb06e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:29.003532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 430/852] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:28 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:38:29.028367 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fbe70-421f-436d-a108-cea50783aa38 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.043928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fbe70-421f-436d-a108-cea50783aa38 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.048250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc2dc2-113f-4124-ba11-76e1352d117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.049017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2dc2-113f-4124-ba11-76e1352d117d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.049289 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2dc2-113f-4124-ba11-76e1352d117d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.049559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2dc2-113f-4124-ba11-76e1352d117d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.060163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc2dc2-113f-4124-ba11-76e1352d117d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:29.066864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-71dc2dc2-113f-4124-ba11-76e1352d117d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:38:29.068379 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 423/853] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:29.074182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2192c9-41f0-47a1-a3d3-d8b22cb06e0e None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.083139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2192c9-41f0-47a1-a3d3-d8b22cb06e0e None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.088430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f986bbd-e827-4a4c-bd58-ba562d0740d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.089086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986bbd-e827-4a4c-bd58-ba562d0740d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.089360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986bbd-e827-4a4c-bd58-ba562d0740d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.089626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986bbd-e827-4a4c-bd58-ba562d0740d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.090378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f986bbd-e827-4a4c-bd58-ba562d0740d5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:29.090672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f986bbd-e827-4a4c-bd58-ba562d0740d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.092309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f986bbd-e827-4a4c-bd58-ba562d0740d5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.101807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 431/854] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:29.107239 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc2dc2-113f-4124-ba11-76e1352d117d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.117817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc2dc2-113f-4124-ba11-76e1352d117d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.122286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748ab5b-8e50-499a-8baf-696a61a2daa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.123065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748ab5b-8e50-499a-8baf-696a61a2daa3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.123370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748ab5b-8e50-499a-8baf-696a61a2daa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.123615 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748ab5b-8e50-499a-8baf-696a61a2daa3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.140190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748ab5b-8e50-499a-8baf-696a61a2daa3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.142008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748ab5b-8e50-499a-8baf-696a61a2daa3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.164909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-e748ab5b-8e50-499a-8baf-696a61a2daa3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:29.166399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 424/855] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:29.171902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f986bbd-e827-4a4c-bd58-ba562d0740d5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.181633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f986bbd-e827-4a4c-bd58-ba562d0740d5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.186061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f0092-9533-4a57-b898-33d925325fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.186702 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f0092-9533-4a57-b898-33d925325fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.187008 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f0092-9533-4a57-b898-33d925325fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.187279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f0092-9533-4a57-b898-33d925325fd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.187998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f0092-9533-4a57-b898-33d925325fd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:29.188299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f0092-9533-4a57-b898-33d925325fd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.189869 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f0092-9533-4a57-b898-33d925325fd3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.201917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 432/856] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:29.207308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748ab5b-8e50-499a-8baf-696a61a2daa3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.217628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748ab5b-8e50-499a-8baf-696a61a2daa3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.219814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3624d-ffc4-453a-b4a6-8d7a50713507 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.220239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3624d-ffc4-453a-b4a6-8d7a50713507 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.220524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3624d-ffc4-453a-b4a6-8d7a50713507 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.222003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb75f2-bbb2-4311-91e4-5a263ff7ba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.222785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb75f2-bbb2-4311-91e4-5a263ff7ba39 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.223103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb75f2-bbb2-4311-91e4-5a263ff7ba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.223343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb75f2-bbb2-4311-91e4-5a263ff7ba39 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.223727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 433/857] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:29.228618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4798896-e2db-4be2-afa7-f442d83cfa13 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.228938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4798896-e2db-4be2-afa7-f442d83cfa13 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.229186 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4798896-e2db-4be2-afa7-f442d83cfa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.233067 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb75f2-bbb2-4311-91e4-5a263ff7ba39 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.235190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb75f2-bbb2-4311-91e4-5a263ff7ba39 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.247952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a4798896-e2db-4be2-afa7-f442d83cfa13 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:29.248973 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-3fdb75f2-bbb2-4311-91e4-5a263ff7ba39 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 24 16:38:29.249576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a4798896-e2db-4be2-afa7-f442d83cfa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:29.250391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 425/858] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:29.255772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb75f2-bbb2-4311-91e4-5a263ff7ba39 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.262576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 434/859] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:29 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:38:29.267080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb75f2-bbb2-4311-91e4-5a263ff7ba39 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.270404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c5f9d-f7a0-4b0f-8657-c38c3eb3c478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.271602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5f9d-f7a0-4b0f-8657-c38c3eb3c478 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.271906 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5f9d-f7a0-4b0f-8657-c38c3eb3c478 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.272144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5f9d-f7a0-4b0f-8657-c38c3eb3c478 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.272984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c5f9d-f7a0-4b0f-8657-c38c3eb3c478 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:29.273286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c5f9d-f7a0-4b0f-8657-c38c3eb3c478 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.275130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c5f9d-f7a0-4b0f-8657-c38c3eb3c478 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.289516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4798896-e2db-4be2-afa7-f442d83cfa13 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.294002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 426/860] 10.222.0.117 () {56 vars in 1161 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:29.299207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4798896-e2db-4be2-afa7-f442d83cfa13 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.299355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c5f9d-f7a0-4b0f-8657-c38c3eb3c478 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.304433 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78672ddb-80bf-4bf4-8cd2-97a4cbaf4dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.305496 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78672ddb-80bf-4bf4-8cd2-97a4cbaf4dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.305776 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78672ddb-80bf-4bf4-8cd2-97a4cbaf4dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.306048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78672ddb-80bf-4bf4-8cd2-97a4cbaf4dc6 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.306857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78672ddb-80bf-4bf4-8cd2-97a4cbaf4dc6 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.308575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78672ddb-80bf-4bf4-8cd2-97a4cbaf4dc6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.309890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c5f9d-f7a0-4b0f-8657-c38c3eb3c478 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.314562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0823d88-8f88-43f7-97a7-7bd242d1490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.315436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0823d88-8f88-43f7-97a7-7bd242d1490e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.315887 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0823d88-8f88-43f7-97a7-7bd242d1490e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.316346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0823d88-8f88-43f7-97a7-7bd242d1490e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.321611 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-78672ddb-80bf-4bf4-8cd2-97a4cbaf4dc6 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 24 16:38:29.325661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0823d88-8f88-43f7-97a7-7bd242d1490e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.326843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 435/861] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:29.327939 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0823d88-8f88-43f7-97a7-7bd242d1490e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.328974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78672ddb-80bf-4bf4-8cd2-97a4cbaf4dc6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.339663 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 427/862] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/auth/tokens => generated 1455 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:38:29.342607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78672ddb-80bf-4bf4-8cd2-97a4cbaf4dc6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.345074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0823d88-8f88-43f7-97a7-7bd242d1490e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.349153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611ee53-e64b-4535-9bba-c7a3f64cdc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.350031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611ee53-e64b-4535-9bba-c7a3f64cdc30 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.350427 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611ee53-e64b-4535-9bba-c7a3f64cdc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.350817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611ee53-e64b-4535-9bba-c7a3f64cdc30 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.351866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611ee53-e64b-4535-9bba-c7a3f64cdc30 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:29.352239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611ee53-e64b-4535-9bba-c7a3f64cdc30 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.353984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611ee53-e64b-4535-9bba-c7a3f64cdc30 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.355508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0823d88-8f88-43f7-97a7-7bd242d1490e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.362825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 436/863] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:29.365197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fc510-ebf8-4c68-9ba0-4bc7c7628750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.365857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611ee53-e64b-4535-9bba-c7a3f64cdc30 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.366439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc510-ebf8-4c68-9ba0-4bc7c7628750 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.366927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc510-ebf8-4c68-9ba0-4bc7c7628750 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.367449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc510-ebf8-4c68-9ba0-4bc7c7628750 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.375688 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611ee53-e64b-4535-9bba-c7a3f64cdc30 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.378520 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fc510-ebf8-4c68-9ba0-4bc7c7628750 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.380997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709b6df-2cbc-4347-b9a6-2fdabd904104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.381717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709b6df-2cbc-4347-b9a6-2fdabd904104 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.381974 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fc510-ebf8-4c68-9ba0-4bc7c7628750 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.382093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709b6df-2cbc-4347-b9a6-2fdabd904104 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.382415 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709b6df-2cbc-4347-b9a6-2fdabd904104 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.383218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709b6df-2cbc-4347-b9a6-2fdabd904104 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:29.383593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709b6df-2cbc-4347-b9a6-2fdabd904104 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.385209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709b6df-2cbc-4347-b9a6-2fdabd904104 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.394782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 437/864] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:29.406559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-224fc510-ebf8-4c68-9ba0-4bc7c7628750 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:29.408433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 428/865] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:29.414986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709b6df-2cbc-4347-b9a6-2fdabd904104 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.425406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709b6df-2cbc-4347-b9a6-2fdabd904104 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.431221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18a77e-1062-4b99-8b43-37988e85575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.432168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18a77e-1062-4b99-8b43-37988e85575c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.432583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18a77e-1062-4b99-8b43-37988e85575c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.433021 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18a77e-1062-4b99-8b43-37988e85575c admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.433906 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18a77e-1062-4b99-8b43-37988e85575c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:29.434411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18a77e-1062-4b99-8b43-37988e85575c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.436417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18a77e-1062-4b99-8b43-37988e85575c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.451762 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 438/866] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:29.457146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fc510-ebf8-4c68-9ba0-4bc7c7628750 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.467832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fc510-ebf8-4c68-9ba0-4bc7c7628750 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.472658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700408-db1a-43de-b3c0-5c126ea7e7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.473458 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700408-db1a-43de-b3c0-5c126ea7e7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.473782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700408-db1a-43de-b3c0-5c126ea7e7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.474741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700408-db1a-43de-b3c0-5c126ea7e7a1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.483262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc700408-db1a-43de-b3c0-5c126ea7e7a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.485349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc700408-db1a-43de-b3c0-5c126ea7e7a1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.500384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-dc700408-db1a-43de-b3c0-5c126ea7e7a1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:29.501971 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 429/867] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:29.507904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18a77e-1062-4b99-8b43-37988e85575c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.518255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18a77e-1062-4b99-8b43-37988e85575c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.523129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f84087-93e4-4f96-9f60-76b407f66f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.523857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f84087-93e4-4f96-9f60-76b407f66f34 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.524134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f84087-93e4-4f96-9f60-76b407f66f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.524403 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f84087-93e4-4f96-9f60-76b407f66f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.525276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f84087-93e4-4f96-9f60-76b407f66f34 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:29.525579 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f84087-93e4-4f96-9f60-76b407f66f34 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.527627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f84087-93e4-4f96-9f60-76b407f66f34 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.541864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 439/868] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:29.547927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700408-db1a-43de-b3c0-5c126ea7e7a1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:29.559240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700408-db1a-43de-b3c0-5c126ea7e7a1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:29.564422 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463e0b0-e84e-490a-9bcd-984d0f3b4f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:29.565112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463e0b0-e84e-490a-9bcd-984d0f3b4f18 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:29.565388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463e0b0-e84e-490a-9bcd-984d0f3b4f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:29.565711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463e0b0-e84e-490a-9bcd-984d0f3b4f18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:29.566557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463e0b0-e84e-490a-9bcd-984d0f3b4f18 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=6a6d64d2408e481db883823e98f4d831) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:29.566928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463e0b0-e84e-490a-9bcd-984d0f3b4f18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:29.569429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463e0b0-e84e-490a-9bcd-984d0f3b4f18 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:29.576367 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 430/869] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:29 2022] GET /identity/v3/role_assignments?user.id=6a6d64d2408e481db883823e98f4d831&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 610 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:30.030348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549ac4b-05eb-4743-8e13-0bb91d7bea25 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:30.030745 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549ac4b-05eb-4743-8e13-0bb91d7bea25 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:30.030982 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549ac4b-05eb-4743-8e13-0bb91d7bea25 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:30.033021 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 440/870] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:30.039073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b62c18-ff75-431d-8649-03abbef7f4c1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:30.039558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b62c18-ff75-431d-8649-03abbef7f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:30.039712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b62c18-ff75-431d-8649-03abbef7f4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:30.057963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-c6b62c18-ff75-431d-8649-03abbef7f4c1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:30.059177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c6b62c18-ff75-431d-8649-03abbef7f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:30.067401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 431/871] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:30 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:30.092993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549ac4b-05eb-4743-8e13-0bb91d7bea25 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:30.105968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549ac4b-05eb-4743-8e13-0bb91d7bea25 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:30.110662 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051507e-bc72-458c-8e0f-71250b209f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:30.111340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051507e-bc72-458c-8e0f-71250b209f24 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:30.111624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051507e-bc72-458c-8e0f-71250b209f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:30.111898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051507e-bc72-458c-8e0f-71250b209f24 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:30.112639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051507e-bc72-458c-8e0f-71250b209f24 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:30.114232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051507e-bc72-458c-8e0f-71250b209f24 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:30.129062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 441/872] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:38:30 2022] POST /identity/v3/services => generated 270 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:31.164512 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837687a-6c1f-48b1-9634-e26bbd0c2b87 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.165109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837687a-6c1f-48b1-9634-e26bbd0c2b87 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.165327 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837687a-6c1f-48b1-9634-e26bbd0c2b87 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.170214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 432/873] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:31 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:31.176690 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0ca5a-deaf-41ec-bcd5-45f3c33266de None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.177845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0ca5a-deaf-41ec-bcd5-45f3c33266de None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.178063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0ca5a-deaf-41ec-bcd5-45f3c33266de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.203900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5fb0ca5a-deaf-41ec-bcd5-45f3c33266de None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:31.205577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5fb0ca5a-deaf-41ec-bcd5-45f3c33266de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:31.225706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 442/874] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:31 2022] POST /identity/v3/auth/tokens => generated 1565 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:31.251317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837687a-6c1f-48b1-9634-e26bbd0c2b87 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.268441 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837687a-6c1f-48b1-9634-e26bbd0c2b87 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.275620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000f73-b02c-45a0-8213-08fe59406414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.276818 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000f73-b02c-45a0-8213-08fe59406414 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.277245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000f73-b02c-45a0-8213-08fe59406414 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.277663 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000f73-b02c-45a0-8213-08fe59406414 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.294278 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8000f73-b02c-45a0-8213-08fe59406414 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:31.306901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-e8000f73-b02c-45a0-8213-08fe59406414 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 24 16:38:31.314925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 433/875] 10.222.0.117 () {56 vars in 1146 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:31.317190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0ca5a-deaf-41ec-bcd5-45f3c33266de None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.329514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0ca5a-deaf-41ec-bcd5-45f3c33266de None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.336129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ca49b-baee-4d67-97bf-6f4ffeb81711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.336851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ca49b-baee-4d67-97bf-6f4ffeb81711 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.337185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ca49b-baee-4d67-97bf-6f4ffeb81711 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.337467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ca49b-baee-4d67-97bf-6f4ffeb81711 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.338362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ca49b-baee-4d67-97bf-6f4ffeb81711 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:31.338871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ca49b-baee-4d67-97bf-6f4ffeb81711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.340696 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ca49b-baee-4d67-97bf-6f4ffeb81711 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.354843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 443/876] 10.222.0.117 () {56 vars in 1141 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:31.357476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000f73-b02c-45a0-8213-08fe59406414 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.368053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000f73-b02c-45a0-8213-08fe59406414 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.372654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87d68-1b55-4825-b332-1eee5d93aec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.373495 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87d68-1b55-4825-b332-1eee5d93aec6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.373776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87d68-1b55-4825-b332-1eee5d93aec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.374049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87d68-1b55-4825-b332-1eee5d93aec6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.385767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87d68-1b55-4825-b332-1eee5d93aec6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.387642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87d68-1b55-4825-b332-1eee5d93aec6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.405066 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-3cd87d68-1b55-4825-b332-1eee5d93aec6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:31.410796 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 434/877] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:31.413104 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ca49b-baee-4d67-97bf-6f4ffeb81711 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.422901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ca49b-baee-4d67-97bf-6f4ffeb81711 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.427704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe11fc-bfbb-4a8f-b2a3-cb7812a55c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.428502 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe11fc-bfbb-4a8f-b2a3-cb7812a55c5f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.428782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe11fc-bfbb-4a8f-b2a3-cb7812a55c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.429052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe11fc-bfbb-4a8f-b2a3-cb7812a55c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.429783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe11fc-bfbb-4a8f-b2a3-cb7812a55c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:31.430092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe11fc-bfbb-4a8f-b2a3-cb7812a55c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.431701 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe11fc-bfbb-4a8f-b2a3-cb7812a55c5f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.448797 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 444/878] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:31.450123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87d68-1b55-4825-b332-1eee5d93aec6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.461569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87d68-1b55-4825-b332-1eee5d93aec6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.466598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e6304-dc86-4cac-b9d5-f3c5db6134aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.467523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e6304-dc86-4cac-b9d5-f3c5db6134aa admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.467802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e6304-dc86-4cac-b9d5-f3c5db6134aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.468124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e6304-dc86-4cac-b9d5-f3c5db6134aa admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.478792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e6304-dc86-4cac-b9d5-f3c5db6134aa admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.480861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e6304-dc86-4cac-b9d5-f3c5db6134aa admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.496982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-b26e6304-dc86-4cac-b9d5-f3c5db6134aa admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 24 16:38:31.502874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 435/879] 10.222.0.117 () {56 vars in 1143 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:31.504243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe11fc-bfbb-4a8f-b2a3-cb7812a55c5f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.514948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe11fc-bfbb-4a8f-b2a3-cb7812a55c5f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.519637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354ff55-0f4e-4349-99b2-a808bb2f65dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.520336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354ff55-0f4e-4349-99b2-a808bb2f65dd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.520620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354ff55-0f4e-4349-99b2-a808bb2f65dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.520966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354ff55-0f4e-4349-99b2-a808bb2f65dd admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.522057 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354ff55-0f4e-4349-99b2-a808bb2f65dd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:31.522362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354ff55-0f4e-4349-99b2-a808bb2f65dd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.524235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354ff55-0f4e-4349-99b2-a808bb2f65dd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.546951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 445/880] 10.222.0.117 () {56 vars in 1175 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:31.548890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e6304-dc86-4cac-b9d5-f3c5db6134aa admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.559892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e6304-dc86-4cac-b9d5-f3c5db6134aa admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.564446 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4e3f3-1348-424f-82b2-5f76b8294086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.565135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4e3f3-1348-424f-82b2-5f76b8294086 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.565417 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4e3f3-1348-424f-82b2-5f76b8294086 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.565693 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4e3f3-1348-424f-82b2-5f76b8294086 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.574858 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4e3f3-1348-424f-82b2-5f76b8294086 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.576603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4e3f3-1348-424f-82b2-5f76b8294086 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.591270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 436/881] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/auth/tokens => generated 1565 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:38:31.595967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354ff55-0f4e-4349-99b2-a808bb2f65dd admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.611148 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354ff55-0f4e-4349-99b2-a808bb2f65dd admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.618298 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1b8ee-f37a-433b-8be2-0c5c0cd89c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.619533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b8ee-f37a-433b-8be2-0c5c0cd89c58 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.620033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b8ee-f37a-433b-8be2-0c5c0cd89c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.620562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b8ee-f37a-433b-8be2-0c5c0cd89c58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.635341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1b8ee-f37a-433b-8be2-0c5c0cd89c58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.637320 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1b8ee-f37a-433b-8be2-0c5c0cd89c58 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.658926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-7ce1b8ee-f37a-433b-8be2-0c5c0cd89c58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:31.665774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 446/882] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:31.667267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4e3f3-1348-424f-82b2-5f76b8294086 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.676564 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4e3f3-1348-424f-82b2-5f76b8294086 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.682205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077f9c5-f18f-4e01-9c41-b92c25819e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.682929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077f9c5-f18f-4e01-9c41-b92c25819e89 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.683212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077f9c5-f18f-4e01-9c41-b92c25819e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.683487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077f9c5-f18f-4e01-9c41-b92c25819e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.684226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077f9c5-f18f-4e01-9c41-b92c25819e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:31.684530 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077f9c5-f18f-4e01-9c41-b92c25819e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.686115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077f9c5-f18f-4e01-9c41-b92c25819e89 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.702878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 437/883] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:31.704881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1b8ee-f37a-433b-8be2-0c5c0cd89c58 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.715382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1b8ee-f37a-433b-8be2-0c5c0cd89c58 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.720060 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e4029-e79f-4ba7-a67a-7b5e5d4500f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.720879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e4029-e79f-4ba7-a67a-7b5e5d4500f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.721164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e4029-e79f-4ba7-a67a-7b5e5d4500f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.721440 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e4029-e79f-4ba7-a67a-7b5e5d4500f8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.729916 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e4029-e79f-4ba7-a67a-7b5e5d4500f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.731957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e4029-e79f-4ba7-a67a-7b5e5d4500f8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.739419 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6c67-2504-43fe-80e5-b7349c27209c None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.739419 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6c67-2504-43fe-80e5-b7349c27209c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.745180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6c67-2504-43fe-80e5-b7349c27209c None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.745180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 438/884] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:31 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:31.748116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-171e4029-e79f-4ba7-a67a-7b5e5d4500f8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:31.749596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 447/885] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:31.751147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806862d-e1a2-43b9-9eed-699348458283 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.751431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806862d-e1a2-43b9-9eed-699348458283 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.751704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806862d-e1a2-43b9-9eed-699348458283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.754972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e4029-e79f-4ba7-a67a-7b5e5d4500f8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.766858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e4029-e79f-4ba7-a67a-7b5e5d4500f8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.772464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e7359-88ce-412a-9143-f875c5600ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.773114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7359-88ce-412a-9143-f875c5600ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.773444 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7359-88ce-412a-9143-f875c5600ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.773721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7359-88ce-412a-9143-f875c5600ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.774569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e7359-88ce-412a-9143-f875c5600ae6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:31.774907 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e7359-88ce-412a-9143-f875c5600ae6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.776393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d806862d-e1a2-43b9-9eed-699348458283 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:31.777144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e7359-88ce-412a-9143-f875c5600ae6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.777846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d806862d-e1a2-43b9-9eed-699348458283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:31.787754 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 439/886] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:31 2022] POST /identity/v3/auth/tokens => generated 1565 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:31.796899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 448/887] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:31.798380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806862d-e1a2-43b9-9eed-699348458283 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.809298 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806862d-e1a2-43b9-9eed-699348458283 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.813582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e7359-88ce-412a-9143-f875c5600ae6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.815639 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c5427-c686-4064-b0cd-78ad038ff5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.816570 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c5427-c686-4064-b0cd-78ad038ff5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.817053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c5427-c686-4064-b0cd-78ad038ff5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.817615 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c5427-c686-4064-b0cd-78ad038ff5d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.818921 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c5427-c686-4064-b0cd-78ad038ff5d3 admin admin] RBAC: Adding query filter params (role.id=62fba91cbca741d1a684f0a9987d388b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=3d89f63c0db746008b7d9da99bd30266) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:31.819457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c5427-c686-4064-b0cd-78ad038ff5d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.821594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c5427-c686-4064-b0cd-78ad038ff5d3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.823818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e7359-88ce-412a-9143-f875c5600ae6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.828570 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 440/888] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/role_assignments?user.id=3d89f63c0db746008b7d9da99bd30266&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=62fba91cbca741d1a684f0a9987d388b => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:31.829352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09a8ad-8a79-4eec-ae70-4479943017ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.830150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09a8ad-8a79-4eec-ae70-4479943017ee admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.830560 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09a8ad-8a79-4eec-ae70-4479943017ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.831013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09a8ad-8a79-4eec-ae70-4479943017ee admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.831888 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09a8ad-8a79-4eec-ae70-4479943017ee admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.833727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09a8ad-8a79-4eec-ae70-4479943017ee admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:31.851206 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 449/889] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:38:31 2022] POST /identity/v3/services => generated 252 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:38:31.896310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509156d-858a-4c09-999b-f3112d2c0949 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.896591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509156d-858a-4c09-999b-f3112d2c0949 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.896867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509156d-858a-4c09-999b-f3112d2c0949 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.899073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 441/890] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:31.906251 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7045b-75f7-447f-ad21-a12c12a493c5 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.906536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7045b-75f7-447f-ad21-a12c12a493c5 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.906854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7045b-75f7-447f-ad21-a12c12a493c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.927817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-69d7045b-75f7-447f-ad21-a12c12a493c5 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:31.929036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-69d7045b-75f7-447f-ad21-a12c12a493c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:31.952465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 450/891] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:31 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:31.976922 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509156d-858a-4c09-999b-f3112d2c0949 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:31.990353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509156d-858a-4c09-999b-f3112d2c0949 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:31.995434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab10d-f86f-49f9-9f49-fb874f9f7cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:31.996384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab10d-f86f-49f9-9f49-fb874f9f7cbd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:31.996674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab10d-f86f-49f9-9f49-fb874f9f7cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:31.996945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab10d-f86f-49f9-9f49-fb874f9f7cbd admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:31.997682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ab10d-f86f-49f9-9f49-fb874f9f7cbd admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:31.999477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ab10d-f86f-49f9-9f49-fb874f9f7cbd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:32.012486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-315ab10d-f86f-49f9-9f49-fb874f9f7cbd admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 24 16:38:32.014068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 442/892] 10.222.0.117 () {56 vars in 1152 bytes} [Mon Jan 24 16:38:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:32.021693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7045b-75f7-447f-ad21-a12c12a493c5 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:32.032722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7045b-75f7-447f-ad21-a12c12a493c5 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:32.039134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722f1b6-df66-4cb5-b843-f3df326cf73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:32.039808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722f1b6-df66-4cb5-b843-f3df326cf73d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:32.040093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722f1b6-df66-4cb5-b843-f3df326cf73d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:32.040372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722f1b6-df66-4cb5-b843-f3df326cf73d admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:32.041106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722f1b6-df66-4cb5-b843-f3df326cf73d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:32.041412 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722f1b6-df66-4cb5-b843-f3df326cf73d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:32.043042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722f1b6-df66-4cb5-b843-f3df326cf73d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:32.048187 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 451/893] 10.222.0.117 () {56 vars in 1148 bytes} [Mon Jan 24 16:38:32 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:32.054342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab10d-f86f-49f9-9f49-fb874f9f7cbd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:32.064360 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab10d-f86f-49f9-9f49-fb874f9f7cbd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:32.069733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b54855-59b1-4c71-a331-362eea27330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:32.070401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b54855-59b1-4c71-a331-362eea27330f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:32.070683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b54855-59b1-4c71-a331-362eea27330f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:32.070993 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b54855-59b1-4c71-a331-362eea27330f admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:32.071724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b54855-59b1-4c71-a331-362eea27330f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:32.072033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b54855-59b1-4c71-a331-362eea27330f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:32.073637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b54855-59b1-4c71-a331-362eea27330f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:32.078942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 443/894] 10.222.0.117 () {56 vars in 1148 bytes} [Mon Jan 24 16:38:32 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:32.480986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621513f5-458e-409f-9a35-f68060a11d28 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:32.481500 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621513f5-458e-409f-9a35-f68060a11d28 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:32.481500 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621513f5-458e-409f-9a35-f68060a11d28 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:32.483513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 452/895] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:32.488809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0030a-30fe-4335-b470-0ec35dfe3a4b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:32.489198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0030a-30fe-4335-b470-0ec35dfe3a4b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:32.489358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0030a-30fe-4335-b470-0ec35dfe3a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:32.507323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-6da0030a-30fe-4335-b470-0ec35dfe3a4b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:32.508482 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-6da0030a-30fe-4335-b470-0ec35dfe3a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:32.516339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 444/896] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:32 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:32.539598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621513f5-458e-409f-9a35-f68060a11d28 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:32.551651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621513f5-458e-409f-9a35-f68060a11d28 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:32.556593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06684517-e282-4dfb-b6fc-366e1679fa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:32.557370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06684517-e282-4dfb-b6fc-366e1679fa6e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:32.557644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06684517-e282-4dfb-b6fc-366e1679fa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:32.557911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06684517-e282-4dfb-b6fc-366e1679fa6e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:32.558565 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06684517-e282-4dfb-b6fc-366e1679fa6e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:32.560168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06684517-e282-4dfb-b6fc-366e1679fa6e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:32.571805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-06684517-e282-4dfb-b6fc-366e1679fa6e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 24 16:38:32.573236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 453/897] 10.222.0.117 () {56 vars in 1158 bytes} [Mon Jan 24 16:38:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:32.579142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0030a-30fe-4335-b470-0ec35dfe3a4b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:32.588302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0030a-30fe-4335-b470-0ec35dfe3a4b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:32.593631 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d016602-b76e-45a9-b8f2-1fef292e6715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:32.594331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d016602-b76e-45a9-b8f2-1fef292e6715 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:32.594619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d016602-b76e-45a9-b8f2-1fef292e6715 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:32.594968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d016602-b76e-45a9-b8f2-1fef292e6715 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:32.595684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d016602-b76e-45a9-b8f2-1fef292e6715 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:32.595984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d016602-b76e-45a9-b8f2-1fef292e6715 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:32.597613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d016602-b76e-45a9-b8f2-1fef292e6715 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:32.603642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 445/898] 10.222.0.117 () {56 vars in 1152 bytes} [Mon Jan 24 16:38:32 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:32.609099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06684517-e282-4dfb-b6fc-366e1679fa6e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:32.619636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06684517-e282-4dfb-b6fc-366e1679fa6e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:32.624257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f22b61-7df8-400e-8903-c00d8e2c6f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:32.624891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22b61-7df8-400e-8903-c00d8e2c6f86 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:32.625224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22b61-7df8-400e-8903-c00d8e2c6f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:32.625496 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22b61-7df8-400e-8903-c00d8e2c6f86 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:32.626268 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f22b61-7df8-400e-8903-c00d8e2c6f86 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:32.626570 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f22b61-7df8-400e-8903-c00d8e2c6f86 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:32.628264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f22b61-7df8-400e-8903-c00d8e2c6f86 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:32.633822 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 454/899] 10.222.0.117 () {56 vars in 1152 bytes} [Mon Jan 24 16:38:32 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:32.639507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d016602-b76e-45a9-b8f2-1fef292e6715 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:32.649654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d016602-b76e-45a9-b8f2-1fef292e6715 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:32.654293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a25cd-d51a-4093-9969-f6b570e55f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:32.655021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a25cd-d51a-4093-9969-f6b570e55f2a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:32.655301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a25cd-d51a-4093-9969-f6b570e55f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:32.655574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a25cd-d51a-4093-9969-f6b570e55f2a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:32.656419 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a25cd-d51a-4093-9969-f6b570e55f2a admin admin] RBAC: Adding query filter params (interface=public, service_id=114d9c711d2541fa977ac4454db5ee69, region_id=RegionOne) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:32.656723 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a25cd-d51a-4093-9969-f6b570e55f2a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:32.658485 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a25cd-d51a-4093-9969-f6b570e55f2a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:32.664782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 446/900] 10.222.0.117 () {56 vars in 1277 bytes} [Mon Jan 24 16:38:32 2022] GET /identity/v3/endpoints?service_id=114d9c711d2541fa977ac4454db5ee69&interface=public®ion_id=RegionOne => generated 195 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:32.670154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f22b61-7df8-400e-8903-c00d8e2c6f86 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:32.680955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f22b61-7df8-400e-8903-c00d8e2c6f86 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:32.685649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a252add-50d9-419e-bcb8-190daf3f5b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:32.686283 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a252add-50d9-419e-bcb8-190daf3f5b64 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:32.686611 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a252add-50d9-419e-bcb8-190daf3f5b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:32.686917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a252add-50d9-419e-bcb8-190daf3f5b64 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:32.687657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a252add-50d9-419e-bcb8-190daf3f5b64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:32.689265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a252add-50d9-419e-bcb8-190daf3f5b64 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:32.696722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 455/901] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:38:32 2022] GET /identity/v3/services => generated 1274 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:38:34.129199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00461ae-d66f-4745-90e6-73611e8c0303 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.130414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00461ae-d66f-4745-90e6-73611e8c0303 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.130414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00461ae-d66f-4745-90e6-73611e8c0303 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.137316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 447/902] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:34 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:34.142830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62a55a-89b2-4369-b8d7-2dcf7040e940 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.143370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62a55a-89b2-4369-b8d7-2dcf7040e940 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.143370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62a55a-89b2-4369-b8d7-2dcf7040e940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.166799 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4c62a55a-89b2-4369-b8d7-2dcf7040e940 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:34.167970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4c62a55a-89b2-4369-b8d7-2dcf7040e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:34.175891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 456/903] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:34 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:34.199517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00461ae-d66f-4745-90e6-73611e8c0303 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.216048 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00461ae-d66f-4745-90e6-73611e8c0303 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.220517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa82c11-fb24-422d-ad46-315dd797e219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.221315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa82c11-fb24-422d-ad46-315dd797e219 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.221597 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa82c11-fb24-422d-ad46-315dd797e219 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.221878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa82c11-fb24-422d-ad46-315dd797e219 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.233242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa82c11-fb24-422d-ad46-315dd797e219 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:34.241543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-eaa82c11-fb24-422d-ad46-315dd797e219 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 24 16:38:34.243166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 448/904] 10.222.0.117 () {56 vars in 1146 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:34.248594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62a55a-89b2-4369-b8d7-2dcf7040e940 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.258396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f739a6-9577-40e3-8bf5-70a3297d05cd None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.258657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62a55a-89b2-4369-b8d7-2dcf7040e940 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.258869 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f739a6-9577-40e3-8bf5-70a3297d05cd None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.259046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f739a6-9577-40e3-8bf5-70a3297d05cd None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.261547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 449/905] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:34.264281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fffd00-0fff-4dc3-90b9-e9549fc98eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.265141 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fffd00-0fff-4dc3-90b9-e9549fc98eac admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.265361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fffd00-0fff-4dc3-90b9-e9549fc98eac admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.265643 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fffd00-0fff-4dc3-90b9-e9549fc98eac admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.266320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0d14-c4b4-41ee-a015-1da6d56c3a54 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.266497 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fffd00-0fff-4dc3-90b9-e9549fc98eac admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:34.266647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0d14-c4b4-41ee-a015-1da6d56c3a54 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.266841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fffd00-0fff-4dc3-90b9-e9549fc98eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.266991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0d14-c4b4-41ee-a015-1da6d56c3a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.268589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fffd00-0fff-4dc3-90b9-e9549fc98eac admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.278652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 457/906] 10.222.0.117 () {56 vars in 1141 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:34.284172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fffd00-0fff-4dc3-90b9-e9549fc98eac admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.285652 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-6b2e0d14-c4b4-41ee-a015-1da6d56c3a54 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:34.286974 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-6b2e0d14-c4b4-41ee-a015-1da6d56c3a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:34.295436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fffd00-0fff-4dc3-90b9-e9549fc98eac admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.295744 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 450/907] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:34 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:38:34.300055 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368c0ba-6df3-4808-a226-f4b4cad8049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.300830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368c0ba-6df3-4808-a226-f4b4cad8049d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.301108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368c0ba-6df3-4808-a226-f4b4cad8049d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.301379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368c0ba-6df3-4808-a226-f4b4cad8049d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.313137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368c0ba-6df3-4808-a226-f4b4cad8049d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.314999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368c0ba-6df3-4808-a226-f4b4cad8049d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.321924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e0d14-c4b4-41ee-a015-1da6d56c3a54 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.332043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e0d14-c4b4-41ee-a015-1da6d56c3a54 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.332722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-2368c0ba-6df3-4808-a226-f4b4cad8049d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:34.335497 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 458/908] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:34.340600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368c0ba-6df3-4808-a226-f4b4cad8049d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.343395 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b3e7f-953c-4e6f-8978-e68f61df6677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.344416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b3e7f-953c-4e6f-8978-e68f61df6677 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.344890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b3e7f-953c-4e6f-8978-e68f61df6677 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.345352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b3e7f-953c-4e6f-8978-e68f61df6677 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.346461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b3e7f-953c-4e6f-8978-e68f61df6677 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.349347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b3e7f-953c-4e6f-8978-e68f61df6677 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.351838 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368c0ba-6df3-4808-a226-f4b4cad8049d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.356401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d5ed1-8fbd-47b2-b9d2-f9ea3cce7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.357038 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d5ed1-8fbd-47b2-b9d2-f9ea3cce7b3e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.357318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d5ed1-8fbd-47b2-b9d2-f9ea3cce7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.357587 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d5ed1-8fbd-47b2-b9d2-f9ea3cce7b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.358317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d5ed1-8fbd-47b2-b9d2-f9ea3cce7b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:34.358619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d5ed1-8fbd-47b2-b9d2-f9ea3cce7b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.360245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d5ed1-8fbd-47b2-b9d2-f9ea3cce7b3e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.361470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-427b3e7f-953c-4e6f-8978-e68f61df6677 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 24 16:38:34.366791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 451/909] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:34.366791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20bf5c-91d5-4477-8924-83492ca57944 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.366791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20bf5c-91d5-4477-8924-83492ca57944 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.366791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20bf5c-91d5-4477-8924-83492ca57944 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.369741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 452/910] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:34.369741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20bf5c-91d5-4477-8924-83492ca57944 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.374680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 459/911] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:34.376109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef561e-8897-4bbd-91ec-ca5b0b962298 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.376397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef561e-8897-4bbd-91ec-ca5b0b962298 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.376671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef561e-8897-4bbd-91ec-ca5b0b962298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.383576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20bf5c-91d5-4477-8924-83492ca57944 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.387864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed8154-8130-4aea-800a-4ae332f6dc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.388505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed8154-8130-4aea-800a-4ae332f6dc99 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.388788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed8154-8130-4aea-800a-4ae332f6dc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.389065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed8154-8130-4aea-800a-4ae332f6dc99 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.389789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed8154-8130-4aea-800a-4ae332f6dc99 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:34.390098 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed8154-8130-4aea-800a-4ae332f6dc99 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.391711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed8154-8130-4aea-800a-4ae332f6dc99 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.395598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-34ef561e-8897-4bbd-91ec-ca5b0b962298 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:34.396796 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 453/912] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:34.397535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed8154-8130-4aea-800a-4ae332f6dc99 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.397777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-34ef561e-8897-4bbd-91ec-ca5b0b962298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:34.406707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed8154-8130-4aea-800a-4ae332f6dc99 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.407957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 460/913] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:34 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:34.408953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef561e-8897-4bbd-91ec-ca5b0b962298 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.411197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950551a4-00c5-4903-8f08-ef8fdfc4e63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.412037 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950551a4-00c5-4903-8f08-ef8fdfc4e63a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.412318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950551a4-00c5-4903-8f08-ef8fdfc4e63a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.412594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950551a4-00c5-4903-8f08-ef8fdfc4e63a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.419473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef561e-8897-4bbd-91ec-ca5b0b962298 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.424327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f856bf0-a350-4529-8b60-f06daf216374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.425192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f856bf0-a350-4529-8b60-f06daf216374 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.425685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f856bf0-a350-4529-8b60-f06daf216374 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.426164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f856bf0-a350-4529-8b60-f06daf216374 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.426487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950551a4-00c5-4903-8f08-ef8fdfc4e63a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.428443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f856bf0-a350-4529-8b60-f06daf216374 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:34.428970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f856bf0-a350-4529-8b60-f06daf216374 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.429194 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950551a4-00c5-4903-8f08-ef8fdfc4e63a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.431082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f856bf0-a350-4529-8b60-f06daf216374 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.436159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 461/914] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:34.437195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f856bf0-a350-4529-8b60-f06daf216374 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.443971 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-950551a4-00c5-4903-8f08-ef8fdfc4e63a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 24 16:38:34.445264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 454/915] 10.222.0.117 () {56 vars in 1143 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:34.446074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950551a4-00c5-4903-8f08-ef8fdfc4e63a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.447065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f856bf0-a350-4529-8b60-f06daf216374 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.452733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64372cc8-712e-4378-b923-b3a95ed2f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.453361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64372cc8-712e-4378-b923-b3a95ed2f5fb admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.453645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64372cc8-712e-4378-b923-b3a95ed2f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.453920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64372cc8-712e-4378-b923-b3a95ed2f5fb admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.454645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64372cc8-712e-4378-b923-b3a95ed2f5fb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.455629 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950551a4-00c5-4903-8f08-ef8fdfc4e63a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.456259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64372cc8-712e-4378-b923-b3a95ed2f5fb admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.460804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ce5ac-8236-4305-a870-5f4d9358d84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.461462 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce5ac-8236-4305-a870-5f4d9358d84e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.461742 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce5ac-8236-4305-a870-5f4d9358d84e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.462065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce5ac-8236-4305-a870-5f4d9358d84e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.463110 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ce5ac-8236-4305-a870-5f4d9358d84e admin admin] RBAC: Adding query filter params (interface=public, service_id=604670be0036449f87a7c4a12b2090ec, region_id=RegionOne) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:34.463532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ce5ac-8236-4305-a870-5f4d9358d84e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.465242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ce5ac-8236-4305-a870-5f4d9358d84e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.470532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 455/916] 10.222.0.117 () {56 vars in 1277 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/endpoints?service_id=604670be0036449f87a7c4a12b2090ec&interface=public®ion_id=RegionOne => generated 195 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:34.471074 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 462/917] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:38:34 2022] POST /identity/v3/services => generated 242 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:34.471335 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ce5ac-8236-4305-a870-5f4d9358d84e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.477120 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64372cc8-712e-4378-b923-b3a95ed2f5fb admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.481785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ce5ac-8236-4305-a870-5f4d9358d84e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.497023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ce6d1-2128-4d43-881b-4c2d5130b1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.497691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ce6d1-2128-4d43-881b-4c2d5130b1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.497974 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ce6d1-2128-4d43-881b-4c2d5130b1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.498250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ce6d1-2128-4d43-881b-4c2d5130b1b6 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.499324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ce6d1-2128-4d43-881b-4c2d5130b1b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:34.499463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ce6d1-2128-4d43-881b-4c2d5130b1b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.501367 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ce6d1-2128-4d43-881b-4c2d5130b1b6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.502458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64372cc8-712e-4378-b923-b3a95ed2f5fb admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.508142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9bcd5-c66a-4ff0-822c-729a6438668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.509181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9bcd5-c66a-4ff0-822c-729a6438668a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.509783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9bcd5-c66a-4ff0-822c-729a6438668a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.510233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9bcd5-c66a-4ff0-822c-729a6438668a admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.511202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9bcd5-c66a-4ff0-822c-729a6438668a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.513151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9bcd5-c66a-4ff0-822c-729a6438668a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.521280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 463/918] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/services => generated 1504 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:38:34.522025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 456/919] 10.222.0.117 () {56 vars in 1175 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:34.533245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9bcd5-c66a-4ff0-822c-729a6438668a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.544936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9bcd5-c66a-4ff0-822c-729a6438668a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.550971 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43249fb1-48ef-4da2-aa26-ed25489fbbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.551895 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43249fb1-48ef-4da2-aa26-ed25489fbbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.552200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43249fb1-48ef-4da2-aa26-ed25489fbbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.552517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43249fb1-48ef-4da2-aa26-ed25489fbbf1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.567101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43249fb1-48ef-4da2-aa26-ed25489fbbf1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.569788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43249fb1-48ef-4da2-aa26-ed25489fbbf1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.589224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-43249fb1-48ef-4da2-aa26-ed25489fbbf1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:34.591061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 464/920] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:34.600089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ce6d1-2128-4d43-881b-4c2d5130b1b6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.611406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ce6d1-2128-4d43-881b-4c2d5130b1b6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.616533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e74c3-d821-43ca-811b-5f40b3b8301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.617316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e74c3-d821-43ca-811b-5f40b3b8301a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.617598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e74c3-d821-43ca-811b-5f40b3b8301a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.617933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e74c3-d821-43ca-811b-5f40b3b8301a admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.618740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e74c3-d821-43ca-811b-5f40b3b8301a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:34.619081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e74c3-d821-43ca-811b-5f40b3b8301a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.620843 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e74c3-d821-43ca-811b-5f40b3b8301a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.636365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 457/921] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:34.642179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43249fb1-48ef-4da2-aa26-ed25489fbbf1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.657625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43249fb1-48ef-4da2-aa26-ed25489fbbf1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.663749 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e599b-416c-4b68-9f7a-3f1c43411d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.664918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e599b-416c-4b68-9f7a-3f1c43411d20 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.665415 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e599b-416c-4b68-9f7a-3f1c43411d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.665893 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e599b-416c-4b68-9f7a-3f1c43411d20 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.674914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e599b-416c-4b68-9f7a-3f1c43411d20 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.677825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e599b-416c-4b68-9f7a-3f1c43411d20 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.693168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-dc4e599b-416c-4b68-9f7a-3f1c43411d20 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:34.695150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 465/922] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:34.701124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e74c3-d821-43ca-811b-5f40b3b8301a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.711867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e74c3-d821-43ca-811b-5f40b3b8301a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.716712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fecfe8-e135-4132-b6b1-3686fd7d26b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.717390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fecfe8-e135-4132-b6b1-3686fd7d26b9 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.717668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fecfe8-e135-4132-b6b1-3686fd7d26b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.717942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fecfe8-e135-4132-b6b1-3686fd7d26b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.718883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fecfe8-e135-4132-b6b1-3686fd7d26b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:34.719150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fecfe8-e135-4132-b6b1-3686fd7d26b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.721075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fecfe8-e135-4132-b6b1-3686fd7d26b9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.736477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 458/923] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:34.743099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e599b-416c-4b68-9f7a-3f1c43411d20 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:34.752794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e599b-416c-4b68-9f7a-3f1c43411d20 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:34.757217 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d84e5c-3d9a-4bc8-b13a-b792d15b5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:34.758081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84e5c-3d9a-4bc8-b13a-b792d15b5267 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.758376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84e5c-3d9a-4bc8-b13a-b792d15b5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.758625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84e5c-3d9a-4bc8-b13a-b792d15b5267 admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/3d89f63c0db746008b7d9da99bd30266/roles/62fba91cbca741d1a684f0a9987d388b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.760819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d84e5c-3d9a-4bc8-b13a-b792d15b5267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=3d89f63c0db746008b7d9da99bd30266, role_id=62fba91cbca741d1a684f0a9987d388b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:34.763457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d84e5c-3d9a-4bc8-b13a-b792d15b5267 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:34.781199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 466/924] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:38:34 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/3d89f63c0db746008b7d9da99bd30266/roles/62fba91cbca741d1a684f0a9987d388b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:38:34.969551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f745c-2063-4c40-8992-d3acf838c31b None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.969885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f745c-2063-4c40-8992-d3acf838c31b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.970058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f745c-2063-4c40-8992-d3acf838c31b None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.971929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 459/925] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:34.978464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61374-4471-43fc-bf04-74d19cb6d184 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:34.978774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61374-4471-43fc-bf04-74d19cb6d184 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:34.979155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61374-4471-43fc-bf04-74d19cb6d184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:34.998347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-22b61374-4471-43fc-bf04-74d19cb6d184 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:34.999540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-22b61374-4471-43fc-bf04-74d19cb6d184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:35.056825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 467/926] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:34 2022] POST /identity/v3/auth/tokens => generated 1768 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:35.079653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f745c-2063-4c40-8992-d3acf838c31b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:35.092628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f745c-2063-4c40-8992-d3acf838c31b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:35.096979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb032f55-914c-49e2-bd4a-81c27009e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:35.097760 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb032f55-914c-49e2-bd4a-81c27009e70b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:35.098035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb032f55-914c-49e2-bd4a-81c27009e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:35.098307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb032f55-914c-49e2-bd4a-81c27009e70b admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:35.099160 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb032f55-914c-49e2-bd4a-81c27009e70b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:35.100832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb032f55-914c-49e2-bd4a-81c27009e70b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:35.112546 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-eb032f55-914c-49e2-bd4a-81c27009e70b admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 24 16:38:35.113961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 460/927] 10.222.0.117 () {56 vars in 1158 bytes} [Mon Jan 24 16:38:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:35.120585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b61374-4471-43fc-bf04-74d19cb6d184 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:35.129390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b61374-4471-43fc-bf04-74d19cb6d184 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:35.139730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ff05f-6709-46fb-8f8c-08bc46caa96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:35.140382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ff05f-6709-46fb-8f8c-08bc46caa96f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:35.140661 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ff05f-6709-46fb-8f8c-08bc46caa96f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:35.140996 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ff05f-6709-46fb-8f8c-08bc46caa96f admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:35.141716 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ff05f-6709-46fb-8f8c-08bc46caa96f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:35.142013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ff05f-6709-46fb-8f8c-08bc46caa96f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:35.143617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ff05f-6709-46fb-8f8c-08bc46caa96f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:35.148742 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 468/928] 10.222.0.117 () {56 vars in 1152 bytes} [Mon Jan 24 16:38:35 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:35.157165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb032f55-914c-49e2-bd4a-81c27009e70b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:35.168871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb032f55-914c-49e2-bd4a-81c27009e70b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:35.173722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a4a95-af01-4e67-9fd5-0c5a5b4c5df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:35.174362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a4a95-af01-4e67-9fd5-0c5a5b4c5df3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:35.174692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a4a95-af01-4e67-9fd5-0c5a5b4c5df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:35.174995 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a4a95-af01-4e67-9fd5-0c5a5b4c5df3 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:35.175709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a4a95-af01-4e67-9fd5-0c5a5b4c5df3 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:35.176056 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a4a95-af01-4e67-9fd5-0c5a5b4c5df3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:35.178405 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a4a95-af01-4e67-9fd5-0c5a5b4c5df3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:35.183738 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 461/929] 10.222.0.117 () {56 vars in 1152 bytes} [Mon Jan 24 16:38:35 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:35.189166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ff05f-6709-46fb-8f8c-08bc46caa96f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:35.199931 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ff05f-6709-46fb-8f8c-08bc46caa96f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:35.204551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4c775-71d0-4efe-8e6f-2573a3d45593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:35.205243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c775-71d0-4efe-8e6f-2573a3d45593 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:35.205523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c775-71d0-4efe-8e6f-2573a3d45593 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:35.205792 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c775-71d0-4efe-8e6f-2573a3d45593 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:35.206601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4c775-71d0-4efe-8e6f-2573a3d45593 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:35.208889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4c775-71d0-4efe-8e6f-2573a3d45593 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:35.229865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 469/930] 10.222.0.117 () {60 vars in 1170 bytes} [Mon Jan 24 16:38:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:38:36.807182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fed813-c15a-4e8a-8af9-dab0d2ddae5f None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:36.807694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fed813-c15a-4e8a-8af9-dab0d2ddae5f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:36.807767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fed813-c15a-4e8a-8af9-dab0d2ddae5f None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:36.809758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 462/931] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:36.816875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2d970-89b7-4108-abc1-c82ee2c93c55 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:36.817997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2d970-89b7-4108-abc1-c82ee2c93c55 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:36.818185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2d970-89b7-4108-abc1-c82ee2c93c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:36.836958 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5fa2d970-89b7-4108-abc1-c82ee2c93c55 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:36.838184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5fa2d970-89b7-4108-abc1-c82ee2c93c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:36.857832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 470/932] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:36 2022] POST /identity/v3/auth/tokens => generated 1956 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:36.882127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fed813-c15a-4e8a-8af9-dab0d2ddae5f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:36.894545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fed813-c15a-4e8a-8af9-dab0d2ddae5f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:36.899272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bac0a-7d1b-449e-9230-12d12270b706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:36.900062 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bac0a-7d1b-449e-9230-12d12270b706 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:36.900341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bac0a-7d1b-449e-9230-12d12270b706 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:36.900614 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bac0a-7d1b-449e-9230-12d12270b706 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:36.901276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bac0a-7d1b-449e-9230-12d12270b706 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:36.902892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bac0a-7d1b-449e-9230-12d12270b706 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:36.915709 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2198-458c-4a2b-9c4b-b2a3d93414f8 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:36.915995 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2198-458c-4a2b-9c4b-b2a3d93414f8 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:36.916156 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-cb9bac0a-7d1b-449e-9230-12d12270b706 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 24 16:38:36.916250 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2198-458c-4a2b-9c4b-b2a3d93414f8 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:36.917612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 463/933] 10.222.0.117 () {56 vars in 1152 bytes} [Mon Jan 24 16:38:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:36.918231 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 471/934] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:36.924114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2198-458c-4a2b-9c4b-b2a3d93414f8 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:36.924314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416f6ae-e95a-4f08-9946-224e4974bcb6 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:36.924566 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416f6ae-e95a-4f08-9946-224e4974bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:36.924849 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416f6ae-e95a-4f08-9946-224e4974bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:36.937215 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2198-458c-4a2b-9c4b-b2a3d93414f8 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:36.941767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb129256-09fb-42e9-a0e8-acfceca9b3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:36.942591 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129256-09fb-42e9-a0e8-acfceca9b3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:36.942912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129256-09fb-42e9-a0e8-acfceca9b3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:36.943192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129256-09fb-42e9-a0e8-acfceca9b3b3 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:36.943778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-c416f6ae-e95a-4f08-9946-224e4974bcb6 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:36.943968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb129256-09fb-42e9-a0e8-acfceca9b3b3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:36.944203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb129256-09fb-42e9-a0e8-acfceca9b3b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:36.944959 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c416f6ae-e95a-4f08-9946-224e4974bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:36.945779 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb129256-09fb-42e9-a0e8-acfceca9b3b3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:36.951338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 472/935] 10.222.0.117 () {56 vars in 1148 bytes} [Mon Jan 24 16:38:36 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:36.954884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 464/936] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:36 2022] POST /identity/v3/auth/tokens => generated 1956 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:38:36.959913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb129256-09fb-42e9-a0e8-acfceca9b3b3 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:36.971594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb129256-09fb-42e9-a0e8-acfceca9b3b3 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:36.977023 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3b10e-5a86-4f39-9be8-10a26547ca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:36.977956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3b10e-5a86-4f39-9be8-10a26547ca9f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:36.978240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3b10e-5a86-4f39-9be8-10a26547ca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:36.978511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3b10e-5a86-4f39-9be8-10a26547ca9f admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:36.979260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3b10e-5a86-4f39-9be8-10a26547ca9f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:36.979562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3b10e-5a86-4f39-9be8-10a26547ca9f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:36.981227 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3b10e-5a86-4f39-9be8-10a26547ca9f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:36.981458 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416f6ae-e95a-4f08-9946-224e4974bcb6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:36.986670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 473/937] 10.222.0.117 () {56 vars in 1148 bytes} [Mon Jan 24 16:38:36 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:36.991442 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416f6ae-e95a-4f08-9946-224e4974bcb6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:36.992830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3b10e-5a86-4f39-9be8-10a26547ca9f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:36.996443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da169ea-249f-45fa-8807-7ef15b6395bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:36.997237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da169ea-249f-45fa-8807-7ef15b6395bd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:36.997521 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da169ea-249f-45fa-8807-7ef15b6395bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:36.997797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da169ea-249f-45fa-8807-7ef15b6395bd admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:36.998477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da169ea-249f-45fa-8807-7ef15b6395bd admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.000135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da169ea-249f-45fa-8807-7ef15b6395bd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.002713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3b10e-5a86-4f39-9be8-10a26547ca9f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.007441 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801992d5-53ee-4feb-be19-df84aed461f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.008081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801992d5-53ee-4feb-be19-df84aed461f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.008361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801992d5-53ee-4feb-be19-df84aed461f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.008624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801992d5-53ee-4feb-be19-df84aed461f5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.009417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801992d5-53ee-4feb-be19-df84aed461f5 admin admin] RBAC: Adding query filter params (interface=public, service_id=8d925fa54c5a4513bb3151553035bf0e, region_id=RegionOne) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:37.009730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801992d5-53ee-4feb-be19-df84aed461f5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.011336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801992d5-53ee-4feb-be19-df84aed461f5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.012040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-7da169ea-249f-45fa-8807-7ef15b6395bd admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 24 16:38:37.016870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 474/939] 10.222.0.117 () {56 vars in 1277 bytes} [Mon Jan 24 16:38:36 2022] GET /identity/v3/endpoints?service_id=8d925fa54c5a4513bb3151553035bf0e&interface=public®ion_id=RegionOne => generated 195 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:37.017062 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 465/939] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:38:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:37.022529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da169ea-249f-45fa-8807-7ef15b6395bd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.023845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801992d5-53ee-4feb-be19-df84aed461f5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.032579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da169ea-249f-45fa-8807-7ef15b6395bd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.033627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801992d5-53ee-4feb-be19-df84aed461f5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.037908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00545d2-bd1c-484d-910f-448f701e97e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.038560 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00545d2-bd1c-484d-910f-448f701e97e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.038888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00545d2-bd1c-484d-910f-448f701e97e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.039172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00545d2-bd1c-484d-910f-448f701e97e8 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.039898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00545d2-bd1c-484d-910f-448f701e97e8 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:37.040206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00545d2-bd1c-484d-910f-448f701e97e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.040617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f78d5f-5998-4051-9ad7-6f8d5701789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.041474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f78d5f-5998-4051-9ad7-6f8d5701789e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.041796 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00545d2-bd1c-484d-910f-448f701e97e8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.042185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f78d5f-5998-4051-9ad7-6f8d5701789e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.042653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f78d5f-5998-4051-9ad7-6f8d5701789e admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.043572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f78d5f-5998-4051-9ad7-6f8d5701789e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.045322 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f78d5f-5998-4051-9ad7-6f8d5701789e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.050868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 466/940] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:37.052773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 475/941] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/services => generated 1504 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:38:37.057551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00545d2-bd1c-484d-910f-448f701e97e8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.063776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00545d2-bd1c-484d-910f-448f701e97e8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.069458 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9125018-d7dd-45a7-9578-3c582d6b603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.070139 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9125018-d7dd-45a7-9578-3c582d6b603c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.070424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9125018-d7dd-45a7-9578-3c582d6b603c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.070699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9125018-d7dd-45a7-9578-3c582d6b603c admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.071478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9125018-d7dd-45a7-9578-3c582d6b603c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:37.071782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9125018-d7dd-45a7-9578-3c582d6b603c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.073426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9125018-d7dd-45a7-9578-3c582d6b603c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.085138 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 467/942] 10.222.0.117 () {56 vars in 1140 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:37.086817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f78d5f-5998-4051-9ad7-6f8d5701789e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.097201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f78d5f-5998-4051-9ad7-6f8d5701789e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.102777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c217c-f4c8-4f97-8dcb-51d66d6084a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.103755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c217c-f4c8-4f97-8dcb-51d66d6084a8 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.104263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c217c-f4c8-4f97-8dcb-51d66d6084a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.104755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c217c-f4c8-4f97-8dcb-51d66d6084a8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.105721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c217c-f4c8-4f97-8dcb-51d66d6084a8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.107578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c217c-f4c8-4f97-8dcb-51d66d6084a8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.115643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aab85-6405-4a96-ab64-0d99cbea5349 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.115989 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aab85-6405-4a96-ab64-0d99cbea5349 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.116226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aab85-6405-4a96-ab64-0d99cbea5349 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.122540 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 468/943] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:37.124798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589bacf-0999-4048-bf9f-313f89d45eed None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.125159 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589bacf-0999-4048-bf9f-313f89d45eed None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.125520 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589bacf-0999-4048-bf9f-313f89d45eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.134855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 476/944] 10.222.0.117 () {60 vars in 1170 bytes} [Mon Jan 24 16:38:37 2022] POST /identity/v3/endpoints => generated 348 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:38:37.154800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e589bacf-0999-4048-bf9f-313f89d45eed None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:37.162817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e589bacf-0999-4048-bf9f-313f89d45eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:37.177728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 469/945] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:37 2022] POST /identity/v3/auth/tokens => generated 2143 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:37.203714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c217c-f4c8-4f97-8dcb-51d66d6084a8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.215947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c217c-f4c8-4f97-8dcb-51d66d6084a8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.221171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774969-c152-4334-9259-00a0be9a4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.222289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774969-c152-4334-9259-00a0be9a4770 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.222853 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774969-c152-4334-9259-00a0be9a4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.223283 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774969-c152-4334-9259-00a0be9a4770 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.236537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59774969-c152-4334-9259-00a0be9a4770 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:37.245138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-59774969-c152-4334-9259-00a0be9a4770 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 24 16:38:37.246960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 477/946] 10.222.0.117 () {56 vars in 1146 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:37.253118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589bacf-0999-4048-bf9f-313f89d45eed None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.265005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589bacf-0999-4048-bf9f-313f89d45eed None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.271509 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f58aed-b5d7-40b1-8905-9226f92bae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.272306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58aed-b5d7-40b1-8905-9226f92bae9d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.272584 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58aed-b5d7-40b1-8905-9226f92bae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.272853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58aed-b5d7-40b1-8905-9226f92bae9d admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.273658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f58aed-b5d7-40b1-8905-9226f92bae9d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:37.273972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f58aed-b5d7-40b1-8905-9226f92bae9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.275687 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f58aed-b5d7-40b1-8905-9226f92bae9d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.286039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 470/947] 10.222.0.117 () {56 vars in 1141 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:37.292216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774969-c152-4334-9259-00a0be9a4770 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.304098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774969-c152-4334-9259-00a0be9a4770 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.309352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b4a48-760a-4538-99c3-1fe4f477bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.310469 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b4a48-760a-4538-99c3-1fe4f477bbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.311014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b4a48-760a-4538-99c3-1fe4f477bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.311511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b4a48-760a-4538-99c3-1fe4f477bbb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.323285 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b4a48-760a-4538-99c3-1fe4f477bbb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.325439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b4a48-760a-4538-99c3-1fe4f477bbb6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.346152 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-260b4a48-760a-4538-99c3-1fe4f477bbb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:37.348018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 478/948] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:37.354268 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f58aed-b5d7-40b1-8905-9226f92bae9d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.365154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f58aed-b5d7-40b1-8905-9226f92bae9d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.369802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79f9be-438b-4c5a-9a75-6ace5c6fead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.370462 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f9be-438b-4c5a-9a75-6ace5c6fead6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.370737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f9be-438b-4c5a-9a75-6ace5c6fead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.371047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f9be-438b-4c5a-9a75-6ace5c6fead6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.371794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79f9be-438b-4c5a-9a75-6ace5c6fead6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:37.372104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79f9be-438b-4c5a-9a75-6ace5c6fead6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.373695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79f9be-438b-4c5a-9a75-6ace5c6fead6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.387323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 471/949] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:37.393345 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b4a48-760a-4538-99c3-1fe4f477bbb6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.411805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b4a48-760a-4538-99c3-1fe4f477bbb6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.417714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520088ac-811b-4834-bc9a-f89af2c9fdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.418501 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520088ac-811b-4834-bc9a-f89af2c9fdce admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.418849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520088ac-811b-4834-bc9a-f89af2c9fdce admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.419061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520088ac-811b-4834-bc9a-f89af2c9fdce admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.428633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520088ac-811b-4834-bc9a-f89af2c9fdce admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.430628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520088ac-811b-4834-bc9a-f89af2c9fdce admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.446214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-520088ac-811b-4834-bc9a-f89af2c9fdce admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 24 16:38:37.447793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 479/950] 10.222.0.117 () {56 vars in 1143 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:37.453314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79f9be-438b-4c5a-9a75-6ace5c6fead6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.463594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79f9be-438b-4c5a-9a75-6ace5c6fead6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.468216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e21dd-f16f-4062-8149-3af99d5c8445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.468952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e21dd-f16f-4062-8149-3af99d5c8445 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.469302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e21dd-f16f-4062-8149-3af99d5c8445 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.469646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e21dd-f16f-4062-8149-3af99d5c8445 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.470568 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e21dd-f16f-4062-8149-3af99d5c8445 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:37.470965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e21dd-f16f-4062-8149-3af99d5c8445 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.472896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e21dd-f16f-4062-8149-3af99d5c8445 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.492285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 472/951] 10.222.0.117 () {56 vars in 1175 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:37.497784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520088ac-811b-4834-bc9a-f89af2c9fdce admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.508943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520088ac-811b-4834-bc9a-f89af2c9fdce admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.513997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3981-9593-47a9-a511-3c7537fab67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.514953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3981-9593-47a9-a511-3c7537fab67b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.515439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3981-9593-47a9-a511-3c7537fab67b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.515981 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3981-9593-47a9-a511-3c7537fab67b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.530886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec3981-9593-47a9-a511-3c7537fab67b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.530886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec3981-9593-47a9-a511-3c7537fab67b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.533823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318568-4521-4d3b-a35b-2eed05f82edb None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.534107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318568-4521-4d3b-a35b-2eed05f82edb None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.534382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318568-4521-4d3b-a35b-2eed05f82edb None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.536739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 473/952] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:37.539723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 480/953] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/auth/tokens => generated 2143 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:38:37.544185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168406fb-74a6-4fb7-9f79-93b6f9bec4f1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.544185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168406fb-74a6-4fb7-9f79-93b6f9bec4f1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.544185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168406fb-74a6-4fb7-9f79-93b6f9bec4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.546048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3981-9593-47a9-a511-3c7537fab67b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.556927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3981-9593-47a9-a511-3c7537fab67b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.562396 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebda890-cd7d-425a-96f6-5c478c176525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.563382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebda890-cd7d-425a-96f6-5c478c176525 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.563662 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebda890-cd7d-425a-96f6-5c478c176525 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.563934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebda890-cd7d-425a-96f6-5c478c176525 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.569806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-168406fb-74a6-4fb7-9f79-93b6f9bec4f1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:37.571321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-168406fb-74a6-4fb7-9f79-93b6f9bec4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:37.574353 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebda890-cd7d-425a-96f6-5c478c176525 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.576482 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebda890-cd7d-425a-96f6-5c478c176525 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.580608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 474/954] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:37 2022] POST /identity/v3/auth/tokens => generated 2143 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:37.595036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-cebda890-cd7d-425a-96f6-5c478c176525 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:37.596339 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 481/955] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:37.602522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168406fb-74a6-4fb7-9f79-93b6f9bec4f1 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.608962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebda890-cd7d-425a-96f6-5c478c176525 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.615801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168406fb-74a6-4fb7-9f79-93b6f9bec4f1 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.619504 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebda890-cd7d-425a-96f6-5c478c176525 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.621300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb897b-11c8-45ae-a68a-bf6596e82dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.622103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb897b-11c8-45ae-a68a-bf6596e82dba admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.622451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb897b-11c8-45ae-a68a-bf6596e82dba admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.622828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb897b-11c8-45ae-a68a-bf6596e82dba admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.623829 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb897b-11c8-45ae-a68a-bf6596e82dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:37.624318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb897b-11c8-45ae-a68a-bf6596e82dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.625497 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331f0a8-560e-4363-8854-6dba24dd203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.626178 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb897b-11c8-45ae-a68a-bf6596e82dba admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.626647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331f0a8-560e-4363-8854-6dba24dd203f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.627114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331f0a8-560e-4363-8854-6dba24dd203f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.627553 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331f0a8-560e-4363-8854-6dba24dd203f admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.628376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331f0a8-560e-4363-8854-6dba24dd203f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.630221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331f0a8-560e-4363-8854-6dba24dd203f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.639924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 475/956] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:37.644577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-1331f0a8-560e-4363-8854-6dba24dd203f admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 24 16:38:37.644577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 482/957] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:37.645727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb897b-11c8-45ae-a68a-bf6596e82dba admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.650127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331f0a8-560e-4363-8854-6dba24dd203f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.656383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb897b-11c8-45ae-a68a-bf6596e82dba admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.660800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331f0a8-560e-4363-8854-6dba24dd203f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.661959 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968675-f7fb-4c19-8b4f-cf44b0725f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.663003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968675-f7fb-4c19-8b4f-cf44b0725f86 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.663565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968675-f7fb-4c19-8b4f-cf44b0725f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.664129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968675-f7fb-4c19-8b4f-cf44b0725f86 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.666460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e755611-1428-434b-9e49-564b7c87ce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.667210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e755611-1428-434b-9e49-564b7c87ce38 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.667576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e755611-1428-434b-9e49-564b7c87ce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.668089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e755611-1428-434b-9e49-564b7c87ce38 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.668804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e755611-1428-434b-9e49-564b7c87ce38 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:37.669179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e755611-1428-434b-9e49-564b7c87ce38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.670868 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e755611-1428-434b-9e49-564b7c87ce38 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.673179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65968675-f7fb-4c19-8b4f-cf44b0725f86 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.675381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65968675-f7fb-4c19-8b4f-cf44b0725f86 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.675983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 483/958] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:37.681765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e755611-1428-434b-9e49-564b7c87ce38 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.691164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e755611-1428-434b-9e49-564b7c87ce38 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.693163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-65968675-f7fb-4c19-8b4f-cf44b0725f86 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:37.695272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 476/959] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:37.700595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b03bf-69ba-4d14-9825-5479a6cb7572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.701236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b03bf-69ba-4d14-9825-5479a6cb7572 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.701520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b03bf-69ba-4d14-9825-5479a6cb7572 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.701796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b03bf-69ba-4d14-9825-5479a6cb7572 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.702502 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b03bf-69ba-4d14-9825-5479a6cb7572 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:37.702837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b03bf-69ba-4d14-9825-5479a6cb7572 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.704396 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b03bf-69ba-4d14-9825-5479a6cb7572 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.706313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968675-f7fb-4c19-8b4f-cf44b0725f86 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.716396 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 484/960] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:37.722915 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968675-f7fb-4c19-8b4f-cf44b0725f86 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.728210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc03297-b132-4eb6-a84a-50193c4c7dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.728888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc03297-b132-4eb6-a84a-50193c4c7dde admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.729231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc03297-b132-4eb6-a84a-50193c4c7dde admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.729510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc03297-b132-4eb6-a84a-50193c4c7dde admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.730383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc03297-b132-4eb6-a84a-50193c4c7dde admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:37.730916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc03297-b132-4eb6-a84a-50193c4c7dde admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.733000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc03297-b132-4eb6-a84a-50193c4c7dde admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.746945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 477/961] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:37.752825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b03bf-69ba-4d14-9825-5479a6cb7572 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:37.764290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b03bf-69ba-4d14-9825-5479a6cb7572 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:37.769326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac73835-a727-40b8-84a9-8adadd7488e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:37.769987 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac73835-a727-40b8-84a9-8adadd7488e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:37.770618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac73835-a727-40b8-84a9-8adadd7488e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:37.770812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac73835-a727-40b8-84a9-8adadd7488e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:37.771619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac73835-a727-40b8-84a9-8adadd7488e5 admin admin] RBAC: Adding query filter params (role.id=62fba91cbca741d1a684f0a9987d388b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=3d89f63c0db746008b7d9da99bd30266) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:37.771932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac73835-a727-40b8-84a9-8adadd7488e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:37.773848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac73835-a727-40b8-84a9-8adadd7488e5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:37.780757 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 485/962] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:37 2022] GET /identity/v3/role_assignments?user.id=3d89f63c0db746008b7d9da99bd30266&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=62fba91cbca741d1a684f0a9987d388b => generated 610 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:39.352526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40334-b901-4568-98d0-2c1fee45f003 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:39.353048 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40334-b901-4568-98d0-2c1fee45f003 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:39.353149 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40334-b901-4568-98d0-2c1fee45f003 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:39.355168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 478/963] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:39.361222 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116b390-bc13-4eec-967a-d3fa789f0da4 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:39.361732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116b390-bc13-4eec-967a-d3fa789f0da4 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:39.361805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116b390-bc13-4eec-967a-d3fa789f0da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:39.381172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-8116b390-bc13-4eec-967a-d3fa789f0da4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:39.382351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8116b390-bc13-4eec-967a-d3fa789f0da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:39.390344 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 486/964] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:39 2022] POST /identity/v3/auth/tokens => generated 2143 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:39.413841 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d40334-b901-4568-98d0-2c1fee45f003 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:39.425879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d40334-b901-4568-98d0-2c1fee45f003 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:39.430934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915a3b-53a5-4399-8834-a8d79aa67cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:39.431712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915a3b-53a5-4399-8834-a8d79aa67cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:39.431989 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915a3b-53a5-4399-8834-a8d79aa67cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:39.432262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915a3b-53a5-4399-8834-a8d79aa67cf6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:39.432924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53915a3b-53a5-4399-8834-a8d79aa67cf6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:39.434511 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53915a3b-53a5-4399-8834-a8d79aa67cf6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:39.446330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-53915a3b-53a5-4399-8834-a8d79aa67cf6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 24 16:38:39.447795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 479/965] 10.222.0.117 () {56 vars in 1152 bytes} [Mon Jan 24 16:38:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:39.453815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116b390-bc13-4eec-967a-d3fa789f0da4 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:39.462996 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116b390-bc13-4eec-967a-d3fa789f0da4 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:39.467557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c8b6f-6408-466f-ab6c-c98a1dbb8742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:39.468205 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c8b6f-6408-466f-ab6c-c98a1dbb8742 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:39.468480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c8b6f-6408-466f-ab6c-c98a1dbb8742 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:39.468746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c8b6f-6408-466f-ab6c-c98a1dbb8742 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:39.469453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c8b6f-6408-466f-ab6c-c98a1dbb8742 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:39.469750 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c8b6f-6408-466f-ab6c-c98a1dbb8742 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:39.471352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c8b6f-6408-466f-ab6c-c98a1dbb8742 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:39.477239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 487/966] 10.222.0.117 () {56 vars in 1148 bytes} [Mon Jan 24 16:38:39 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:39.482784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915a3b-53a5-4399-8834-a8d79aa67cf6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:39.492980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915a3b-53a5-4399-8834-a8d79aa67cf6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:39.497531 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca156679-7af3-436d-afed-874f0f5f8cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:39.498172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156679-7af3-436d-afed-874f0f5f8cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:39.498453 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156679-7af3-436d-afed-874f0f5f8cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:39.498723 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156679-7af3-436d-afed-874f0f5f8cc7 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:39.499466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca156679-7af3-436d-afed-874f0f5f8cc7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:39.499763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca156679-7af3-436d-afed-874f0f5f8cc7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:39.501331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca156679-7af3-436d-afed-874f0f5f8cc7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:39.507228 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 480/967] 10.222.0.117 () {56 vars in 1148 bytes} [Mon Jan 24 16:38:39 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:39.512728 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c8b6f-6408-466f-ab6c-c98a1dbb8742 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:39.522618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c8b6f-6408-466f-ab6c-c98a1dbb8742 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:39.527218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df518f-d457-4e26-91a6-60b68d9ed301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:39.527855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df518f-d457-4e26-91a6-60b68d9ed301 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:39.528129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df518f-d457-4e26-91a6-60b68d9ed301 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:39.528397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df518f-d457-4e26-91a6-60b68d9ed301 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:39.529145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df518f-d457-4e26-91a6-60b68d9ed301 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:39.530706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df518f-d457-4e26-91a6-60b68d9ed301 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:39.552337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 488/968] 10.222.0.117 () {60 vars in 1170 bytes} [Mon Jan 24 16:38:39 2022] POST /identity/v3/endpoints => generated 351 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:39.620139 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6b369-e7c0-4cf0-978d-a002154ef949 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:39.620464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6b369-e7c0-4cf0-978d-a002154ef949 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:39.620702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6b369-e7c0-4cf0-978d-a002154ef949 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:39.622859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 481/969] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:39.628799 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a909b4-6ac1-465c-9341-a34aef9c1f24 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:39.629095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a909b4-6ac1-465c-9341-a34aef9c1f24 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:39.629352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a909b4-6ac1-465c-9341-a34aef9c1f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:39.649122 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f8a909b4-6ac1-465c-9341-a34aef9c1f24 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:39.650359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f8a909b4-6ac1-465c-9341-a34aef9c1f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:39.674976 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 489/970] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:39 2022] POST /identity/v3/auth/tokens => generated 2333 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:39.695469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6b369-e7c0-4cf0-978d-a002154ef949 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:39.708988 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6b369-e7c0-4cf0-978d-a002154ef949 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:39.713728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54874f4a-2ab8-42ff-ab42-65fbc61f5ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:39.714388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54874f4a-2ab8-42ff-ab42-65fbc61f5ffe admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:39.714666 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54874f4a-2ab8-42ff-ab42-65fbc61f5ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:39.714972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54874f4a-2ab8-42ff-ab42-65fbc61f5ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:39.715775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54874f4a-2ab8-42ff-ab42-65fbc61f5ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:39.717623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54874f4a-2ab8-42ff-ab42-65fbc61f5ffe admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:39.719023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.common [None req-54874f4a-2ab8-42ff-ab42-65fbc61f5ffe admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 24 16:38:39.742980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.sql.core [None req-54874f4a-2ab8-42ff-ab42-65fbc61f5ffe admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 24 16:38:39.742980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 24 16:38:39.742980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [parameters: {'id': '0dbb1a6b018c4f4f8bd24cbd0260cb15', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 24 16:38:39.742980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90770) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 24 16:38:39.749351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-54874f4a-2ab8-42ff-ab42-65fbc61f5ffe admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0dbb1a6b018c4f4f8bd24cbd0260cb15.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0dbb1a6b018c4f4f8bd24cbd0260cb15. Jan 24 16:38:39.750627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 482/971] 10.222.0.117 () {60 vars in 1166 bytes} [Mon Jan 24 16:38:39 2022] POST /identity/v3/projects => generated 262 bytes in 56 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:39.756622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a909b4-6ac1-465c-9341-a34aef9c1f24 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:39.765612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a909b4-6ac1-465c-9341-a34aef9c1f24 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:39.771836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d64b-3542-484d-97ff-224fe6a8bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:39.772614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d64b-3542-484d-97ff-224fe6a8bb68 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:39.772894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d64b-3542-484d-97ff-224fe6a8bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:39.773164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d64b-3542-484d-97ff-224fe6a8bb68 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:39.780377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889d64b-3542-484d-97ff-224fe6a8bb68 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:39.782312 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889d64b-3542-484d-97ff-224fe6a8bb68 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:39.796058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-7889d64b-3542-484d-97ff-224fe6a8bb68 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:39.797545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 490/972] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:39.803588 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54874f4a-2ab8-42ff-ab42-65fbc61f5ffe admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:39.813674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54874f4a-2ab8-42ff-ab42-65fbc61f5ffe admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:39.819190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4e347-b579-458c-9e0d-2ff4c2fad871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:39.819847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e347-b579-458c-9e0d-2ff4c2fad871 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:39.820123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e347-b579-458c-9e0d-2ff4c2fad871 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:39.820394 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e347-b579-458c-9e0d-2ff4c2fad871 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:39.821167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4e347-b579-458c-9e0d-2ff4c2fad871 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:39.821470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4e347-b579-458c-9e0d-2ff4c2fad871 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:39.823582 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4e347-b579-458c-9e0d-2ff4c2fad871 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:39.846310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 483/973] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:39 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:40.102333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa071bac-c35b-48ca-88c5-2ef6697e5025 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:40.102333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa071bac-c35b-48ca-88c5-2ef6697e5025 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:40.102333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa071bac-c35b-48ca-88c5-2ef6697e5025 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:40.103239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 491/974] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:40.110744 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15432-0906-4849-9927-89a9658f52f5 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:40.110744 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15432-0906-4849-9927-89a9658f52f5 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:40.110744 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15432-0906-4849-9927-89a9658f52f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:40.130931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-97b15432-0906-4849-9927-89a9658f52f5 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:40.131696 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b8d7a-f0d8-4700-a310-0c7c1f3b291c None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:40.131986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b8d7a-f0d8-4700-a310-0c7c1f3b291c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:40.132268 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b8d7a-f0d8-4700-a310-0c7c1f3b291c None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:40.133821 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-97b15432-0906-4849-9927-89a9658f52f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:40.139192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 492/975] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:40 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:40.142521 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 484/976] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:40 2022] POST /identity/v3/auth/tokens => generated 2333 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:40.146806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dbf20-9ae3-454e-8d99-c6b83c991c92 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:40.146806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dbf20-9ae3-454e-8d99-c6b83c991c92 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:40.146806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dbf20-9ae3-454e-8d99-c6b83c991c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:40.168109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15432-0906-4849-9927-89a9658f52f5 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:40.170109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a74dbf20-9ae3-454e-8d99-c6b83c991c92 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:40.171291 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a74dbf20-9ae3-454e-8d99-c6b83c991c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:40.178680 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15432-0906-4849-9927-89a9658f52f5 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:40.180501 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 493/977] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:40 2022] POST /identity/v3/auth/tokens => generated 2333 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:40.183865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c9a7f-69cb-44de-9981-efff4ab993b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:40.184746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c9a7f-69cb-44de-9981-efff4ab993b0 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:40.185253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c9a7f-69cb-44de-9981-efff4ab993b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:40.185726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c9a7f-69cb-44de-9981-efff4ab993b0 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:40.186666 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c9a7f-69cb-44de-9981-efff4ab993b0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:40.188567 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c9a7f-69cb-44de-9981-efff4ab993b0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:40.204530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dbf20-9ae3-454e-8d99-c6b83c991c92 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:40.205927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 485/978] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:38:40 2022] POST /identity/v3/services => generated 243 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:40.214876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dbf20-9ae3-454e-8d99-c6b83c991c92 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:40.231446 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9d417-e874-4b10-b190-16ad2c28aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:40.232246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9d417-e874-4b10-b190-16ad2c28aed8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:40.232525 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9d417-e874-4b10-b190-16ad2c28aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:40.232797 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9d417-e874-4b10-b190-16ad2c28aed8 admin admin] PATH_INFO: `/v3/services/image` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:40.233473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9d417-e874-4b10-b190-16ad2c28aed8 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:40.235152 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9d417-e874-4b10-b190-16ad2c28aed8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:40.248188 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-cbf9d417-e874-4b10-b190-16ad2c28aed8 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 24 16:38:40.249746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 494/979] 10.222.0.117 () {56 vars in 1131 bytes} [Mon Jan 24 16:38:40 2022] GET /identity/v3/services/image => generated 86 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:40.256597 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c9a7f-69cb-44de-9981-efff4ab993b0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:40.267476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c9a7f-69cb-44de-9981-efff4ab993b0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:40.273869 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb858db-ac9e-4fe0-84f0-256180497983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:40.274598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb858db-ac9e-4fe0-84f0-256180497983 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:40.274915 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb858db-ac9e-4fe0-84f0-256180497983 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:40.275192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb858db-ac9e-4fe0-84f0-256180497983 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:40.275996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb858db-ac9e-4fe0-84f0-256180497983 admin admin] RBAC: Adding query filter params (name=image) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:40.276301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb858db-ac9e-4fe0-84f0-256180497983 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:40.277994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb858db-ac9e-4fe0-84f0-256180497983 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:40.283892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 486/980] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:40 2022] GET /identity/v3/services?name=image => generated 123 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:40.290291 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9d417-e874-4b10-b190-16ad2c28aed8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:40.301281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9d417-e874-4b10-b190-16ad2c28aed8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:40.312781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df0195-6378-4d14-b11b-69f6bbe80c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:40.313562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df0195-6378-4d14-b11b-69f6bbe80c31 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:40.313790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df0195-6378-4d14-b11b-69f6bbe80c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:40.314065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df0195-6378-4d14-b11b-69f6bbe80c31 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:40.314886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df0195-6378-4d14-b11b-69f6bbe80c31 admin admin] RBAC: Adding query filter params (type=image) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:40.315182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df0195-6378-4d14-b11b-69f6bbe80c31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:40.316974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df0195-6378-4d14-b11b-69f6bbe80c31 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:40.323630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 495/981] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:40 2022] GET /identity/v3/services?type=image => generated 123 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:41.902228 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71363cb1-d583-429f-8cca-5e011dcc1afd None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:41.902766 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71363cb1-d583-429f-8cca-5e011dcc1afd None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:41.902766 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71363cb1-d583-429f-8cca-5e011dcc1afd None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:41.904839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 487/982] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:41.910326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c099e32-38e8-42e7-b949-b6924a09400f None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:41.911470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c099e32-38e8-42e7-b949-b6924a09400f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:41.911470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c099e32-38e8-42e7-b949-b6924a09400f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:41.931804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4c099e32-38e8-42e7-b949-b6924a09400f None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:41.933029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4c099e32-38e8-42e7-b949-b6924a09400f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:41.941148 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 496/983] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:41 2022] POST /identity/v3/auth/tokens => generated 2429 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:41.965981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71363cb1-d583-429f-8cca-5e011dcc1afd None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:41.979558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71363cb1-d583-429f-8cca-5e011dcc1afd None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:41.985073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37398fdb-cac7-44f1-91e9-b6bbc887d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:41.986096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398fdb-cac7-44f1-91e9-b6bbc887d4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:41.986692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398fdb-cac7-44f1-91e9-b6bbc887d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:41.987188 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398fdb-cac7-44f1-91e9-b6bbc887d4e2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:41.988058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37398fdb-cac7-44f1-91e9-b6bbc887d4e2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:41.989857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37398fdb-cac7-44f1-91e9-b6bbc887d4e2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.001672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-37398fdb-cac7-44f1-91e9-b6bbc887d4e2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 24 16:38:42.003125 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 488/984] 10.222.0.117 () {56 vars in 1152 bytes} [Mon Jan 24 16:38:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:42.012085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c099e32-38e8-42e7-b949-b6924a09400f None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.022427 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c099e32-38e8-42e7-b949-b6924a09400f None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.027123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f64bc1-f432-493b-95b9-ab24a5e6fee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.027774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64bc1-f432-493b-95b9-ab24a5e6fee9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.028055 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64bc1-f432-493b-95b9-ab24a5e6fee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.028321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64bc1-f432-493b-95b9-ab24a5e6fee9 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.029033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f64bc1-f432-493b-95b9-ab24a5e6fee9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:42.029329 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f64bc1-f432-493b-95b9-ab24a5e6fee9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.030935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f64bc1-f432-493b-95b9-ab24a5e6fee9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.041662 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 497/985] 10.222.0.117 () {56 vars in 1148 bytes} [Mon Jan 24 16:38:42 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:42.042995 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37398fdb-cac7-44f1-91e9-b6bbc887d4e2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.053217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37398fdb-cac7-44f1-91e9-b6bbc887d4e2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.058108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f7e24-1bfa-4567-8e32-9ed7c98ac16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.059074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f7e24-1bfa-4567-8e32-9ed7c98ac16d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.059548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f7e24-1bfa-4567-8e32-9ed7c98ac16d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.060024 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f7e24-1bfa-4567-8e32-9ed7c98ac16d admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.060927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f7e24-1bfa-4567-8e32-9ed7c98ac16d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:42.061430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f7e24-1bfa-4567-8e32-9ed7c98ac16d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.063220 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f7e24-1bfa-4567-8e32-9ed7c98ac16d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.069838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 489/986] 10.222.0.117 () {56 vars in 1148 bytes} [Mon Jan 24 16:38:42 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:42.075600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f64bc1-f432-493b-95b9-ab24a5e6fee9 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.085557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f64bc1-f432-493b-95b9-ab24a5e6fee9 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.090458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a690290-3fcd-4f05-975e-5735738dcd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.091135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a690290-3fcd-4f05-975e-5735738dcd10 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.091414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a690290-3fcd-4f05-975e-5735738dcd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.091685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a690290-3fcd-4f05-975e-5735738dcd10 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.092486 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a690290-3fcd-4f05-975e-5735738dcd10 admin admin] RBAC: Adding query filter params (interface=admin, service_id=8d925fa54c5a4513bb3151553035bf0e, region_id=RegionOne) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:42.092794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a690290-3fcd-4f05-975e-5735738dcd10 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.094372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a690290-3fcd-4f05-975e-5735738dcd10 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.105299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 498/987] 10.222.0.117 () {56 vars in 1275 bytes} [Mon Jan 24 16:38:42 2022] GET /identity/v3/endpoints?service_id=8d925fa54c5a4513bb3151553035bf0e&interface=admin®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:42.106708 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f7e24-1bfa-4567-8e32-9ed7c98ac16d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.117374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f7e24-1bfa-4567-8e32-9ed7c98ac16d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.122060 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafeb21-63d6-42f9-a97e-b3826f2650ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.122717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafeb21-63d6-42f9-a97e-b3826f2650ad admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.123036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafeb21-63d6-42f9-a97e-b3826f2650ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.123310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafeb21-63d6-42f9-a97e-b3826f2650ad admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.124006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafeb21-63d6-42f9-a97e-b3826f2650ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.125595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafeb21-63d6-42f9-a97e-b3826f2650ad admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.138966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 490/988] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:38:42 2022] GET /identity/v3/services => generated 1735 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:38:42.170244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806e69-49f8-4a1f-b29e-15619102e054 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.170555 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806e69-49f8-4a1f-b29e-15619102e054 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.170812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806e69-49f8-4a1f-b29e-15619102e054 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.173019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 499/989] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:42.179476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab88a-daf9-4a94-b9b1-75a052d1a3e6 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.179994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab88a-daf9-4a94-b9b1-75a052d1a3e6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.180419 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab88a-daf9-4a94-b9b1-75a052d1a3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.199872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-2e1ab88a-daf9-4a94-b9b1-75a052d1a3e6 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:42.201336 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-2e1ab88a-daf9-4a94-b9b1-75a052d1a3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:42.210177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 491/990] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:42 2022] POST /identity/v3/auth/tokens => generated 2429 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:42.237224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806e69-49f8-4a1f-b29e-15619102e054 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.250962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806e69-49f8-4a1f-b29e-15619102e054 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.255820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbe152-f26f-4c7f-a557-69a57c313e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.256572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbe152-f26f-4c7f-a557-69a57c313e0a admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.256923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbe152-f26f-4c7f-a557-69a57c313e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.257265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbe152-f26f-4c7f-a557-69a57c313e0a admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.258166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbe152-f26f-4c7f-a557-69a57c313e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.260142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbe152-f26f-4c7f-a557-69a57c313e0a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.261578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.common [None req-4ecbe152-f26f-4c7f-a557-69a57c313e0a admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 24 16:38:42.275123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.sql.core [None req-4ecbe152-f26f-4c7f-a557-69a57c313e0a admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 24 16:38:42.275123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 24 16:38:42.275123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [parameters: {'user_id': 'dd4af84a9db84144a84cf546d606f40a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 24 16:38:42.275123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90771) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 24 16:38:42.291618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-4ecbe152-f26f-4c7f-a557-69a57c313e0a admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 24 16:38:42.293551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 500/991] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:38:42 2022] POST /identity/v3/users => generated 160 bytes in 57 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:42.299605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ab88a-daf9-4a94-b9b1-75a052d1a3e6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.313848 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ab88a-daf9-4a94-b9b1-75a052d1a3e6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.321492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d881366-a887-4576-ac6b-dc5f26697dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.322345 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d881366-a887-4576-ac6b-dc5f26697dde admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.322626 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d881366-a887-4576-ac6b-dc5f26697dde admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.322982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d881366-a887-4576-ac6b-dc5f26697dde admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.330958 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d881366-a887-4576-ac6b-dc5f26697dde admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.333809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d881366-a887-4576-ac6b-dc5f26697dde admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.349206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-0d881366-a887-4576-ac6b-dc5f26697dde admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 24 16:38:42.350463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 492/992] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:42.356679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbe152-f26f-4c7f-a557-69a57c313e0a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.368822 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbe152-f26f-4c7f-a557-69a57c313e0a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.374258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400d230-c536-433c-bc64-320f5e153434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.375033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400d230-c536-433c-bc64-320f5e153434 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.375310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400d230-c536-433c-bc64-320f5e153434 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.375672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400d230-c536-433c-bc64-320f5e153434 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.376612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400d230-c536-433c-bc64-320f5e153434 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:42.376920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400d230-c536-433c-bc64-320f5e153434 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.379129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400d230-c536-433c-bc64-320f5e153434 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.421620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 501/993] 10.222.0.117 () {56 vars in 1127 bytes} [Mon Jan 24 16:38:42 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:42.547768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dee9e-3430-459e-b6ef-72beb86c2c28 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.548428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dee9e-3430-459e-b6ef-72beb86c2c28 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.548911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dee9e-3430-459e-b6ef-72beb86c2c28 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.551970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 493/994] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:42 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:42.557846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48210e-7159-49ec-b60a-1d59d506160f None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.558131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48210e-7159-49ec-b60a-1d59d506160f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.558411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48210e-7159-49ec-b60a-1d59d506160f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.578369 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-fe48210e-7159-49ec-b60a-1d59d506160f None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:42.579969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-fe48210e-7159-49ec-b60a-1d59d506160f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:42.589438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 502/995] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:42 2022] POST /identity/v3/auth/tokens => generated 2429 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:42.612853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dee9e-3430-459e-b6ef-72beb86c2c28 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.626410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dee9e-3430-459e-b6ef-72beb86c2c28 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.631225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a443a77-5744-4571-aa2e-86ce1e2f98b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.632255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a443a77-5744-4571-aa2e-86ce1e2f98b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.632532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a443a77-5744-4571-aa2e-86ce1e2f98b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.632806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a443a77-5744-4571-aa2e-86ce1e2f98b8 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.633468 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a443a77-5744-4571-aa2e-86ce1e2f98b8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.635354 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a443a77-5744-4571-aa2e-86ce1e2f98b8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.648033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-5a443a77-5744-4571-aa2e-86ce1e2f98b8 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 24 16:38:42.649224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 494/996] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:42.655302 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48210e-7159-49ec-b60a-1d59d506160f None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.669270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48210e-7159-49ec-b60a-1d59d506160f None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.674909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413426c-3da6-4844-9ee3-333f42539b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.675512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413426c-3da6-4844-9ee3-333f42539b20 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.675790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413426c-3da6-4844-9ee3-333f42539b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.676062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413426c-3da6-4844-9ee3-333f42539b20 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.676973 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413426c-3da6-4844-9ee3-333f42539b20 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:42.677278 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413426c-3da6-4844-9ee3-333f42539b20 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.678936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413426c-3da6-4844-9ee3-333f42539b20 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.686065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 503/997] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:42 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:42.692882 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eb064-1d36-4100-a7e1-7bb0e25bb03f None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.693125 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413426c-3da6-4844-9ee3-333f42539b20 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.693294 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eb064-1d36-4100-a7e1-7bb0e25bb03f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.693556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eb064-1d36-4100-a7e1-7bb0e25bb03f None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.695504 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 495/998] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:42.700434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7009-5113-4600-a294-f9ce1ebf6ed6 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.700722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7009-5113-4600-a294-f9ce1ebf6ed6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.701003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7009-5113-4600-a294-f9ce1ebf6ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.704489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413426c-3da6-4844-9ee3-333f42539b20 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.712076 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8dbb6-9232-40ac-8863-99693075ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.712962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8dbb6-9232-40ac-8863-99693075ae10 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.713431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8dbb6-9232-40ac-8863-99693075ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.713874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8dbb6-9232-40ac-8863-99693075ae10 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.714795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8dbb6-9232-40ac-8863-99693075ae10 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:42.715274 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8dbb6-9232-40ac-8863-99693075ae10 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.717616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8dbb6-9232-40ac-8863-99693075ae10 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.721634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b44f7009-5113-4600-a294-f9ce1ebf6ed6 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:42.722852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b44f7009-5113-4600-a294-f9ce1ebf6ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:42.723909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 504/999] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:42 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:42.729596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8dbb6-9232-40ac-8863-99693075ae10 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.731712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 496/1000] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:42 2022] POST /identity/v3/auth/tokens => generated 2429 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:42.739270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8dbb6-9232-40ac-8863-99693075ae10 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.743598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc10b52-51b9-47ba-9f62-581d414b418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.744262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc10b52-51b9-47ba-9f62-581d414b418d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.744542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc10b52-51b9-47ba-9f62-581d414b418d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.744811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc10b52-51b9-47ba-9f62-581d414b418d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.745585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc10b52-51b9-47ba-9f62-581d414b418d admin admin] RBAC: Adding query filter params (interface=public, service_id=32d8d1cddbe545dd8bafb125be752304, region_id=RegionOne) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:42.745887 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc10b52-51b9-47ba-9f62-581d414b418d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.747468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc10b52-51b9-47ba-9f62-581d414b418d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.752431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 505/1001] 10.222.0.117 () {56 vars in 1277 bytes} [Mon Jan 24 16:38:42 2022] GET /identity/v3/endpoints?service_id=32d8d1cddbe545dd8bafb125be752304&interface=public®ion_id=RegionOne => generated 195 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:42.754338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f7009-5113-4600-a294-f9ce1ebf6ed6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.757627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc10b52-51b9-47ba-9f62-581d414b418d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:42.763384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f7009-5113-4600-a294-f9ce1ebf6ed6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.766846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc10b52-51b9-47ba-9f62-581d414b418d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:42.768041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d814ee-416a-4f48-a90d-0f42fb6b93ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.768683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d814ee-416a-4f48-a90d-0f42fb6b93ad admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.769019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d814ee-416a-4f48-a90d-0f42fb6b93ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.769301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d814ee-416a-4f48-a90d-0f42fb6b93ad admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.770701 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d814ee-416a-4f48-a90d-0f42fb6b93ad admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.772370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d814ee-416a-4f48-a90d-0f42fb6b93ad admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.772551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f80f0-fa40-4063-9f27-ef839094a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:42.773179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f80f0-fa40-4063-9f27-ef839094a598 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:42.773461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f80f0-fa40-4063-9f27-ef839094a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:42.773736 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f80f0-fa40-4063-9f27-ef839094a598 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:42.774420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f80f0-fa40-4063-9f27-ef839094a598 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:42.776003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f80f0-fa40-4063-9f27-ef839094a598 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:42.783151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 506/1002] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:38:42 2022] GET /identity/v3/services => generated 1735 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:38:42.794076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 497/1003] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:38:42 2022] POST /identity/v3/services => generated 243 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:44.446383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66de4-898c-4945-8f9e-a528cb90400e None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:44.446898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66de4-898c-4945-8f9e-a528cb90400e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:44.446898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66de4-898c-4945-8f9e-a528cb90400e None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:44.448688 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 507/1004] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:44.453963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc196-495e-480a-a240-c6538ae533d1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:44.454379 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc196-495e-480a-a240-c6538ae533d1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:44.454601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc196-495e-480a-a240-c6538ae533d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:44.472711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-dd0cc196-495e-480a-a240-c6538ae533d1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:44.473940 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dd0cc196-495e-480a-a240-c6538ae533d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:44.491163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 498/1005] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:44 2022] POST /identity/v3/auth/tokens => generated 2525 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:44.515182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce66de4-898c-4945-8f9e-a528cb90400e None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:44.527884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce66de4-898c-4945-8f9e-a528cb90400e None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:44.532178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172475c-723d-4ca1-9eaa-186cd3b6db9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:44.532956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172475c-723d-4ca1-9eaa-186cd3b6db9c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:44.533236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172475c-723d-4ca1-9eaa-186cd3b6db9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:44.533505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172475c-723d-4ca1-9eaa-186cd3b6db9c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:44.534160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172475c-723d-4ca1-9eaa-186cd3b6db9c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:44.535860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172475c-723d-4ca1-9eaa-186cd3b6db9c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:44.547231 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-2172475c-723d-4ca1-9eaa-186cd3b6db9c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 24 16:38:44.548593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 508/1006] 10.222.0.117 () {56 vars in 1152 bytes} [Mon Jan 24 16:38:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:44.554801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cc196-495e-480a-a240-c6538ae533d1 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:44.563780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cc196-495e-480a-a240-c6538ae533d1 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:44.568862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eb1e8-3dd3-4847-834b-671b3321d56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:44.569513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb1e8-3dd3-4847-834b-671b3321d56b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:44.569795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb1e8-3dd3-4847-834b-671b3321d56b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:44.570071 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb1e8-3dd3-4847-834b-671b3321d56b admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:44.570818 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eb1e8-3dd3-4847-834b-671b3321d56b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:44.571126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eb1e8-3dd3-4847-834b-671b3321d56b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:44.572712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eb1e8-3dd3-4847-834b-671b3321d56b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:44.577722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 499/1007] 10.222.0.117 () {56 vars in 1148 bytes} [Mon Jan 24 16:38:44 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:44.583459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172475c-723d-4ca1-9eaa-186cd3b6db9c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:44.592941 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172475c-723d-4ca1-9eaa-186cd3b6db9c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:44.597382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef67e76-deb1-4bd4-a3ef-f6c1e397aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:44.598613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef67e76-deb1-4bd4-a3ef-f6c1e397aef3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:44.598938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef67e76-deb1-4bd4-a3ef-f6c1e397aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:44.599278 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef67e76-deb1-4bd4-a3ef-f6c1e397aef3 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:44.599927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef67e76-deb1-4bd4-a3ef-f6c1e397aef3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:44.600228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef67e76-deb1-4bd4-a3ef-f6c1e397aef3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:44.602075 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef67e76-deb1-4bd4-a3ef-f6c1e397aef3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:44.607404 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 509/1008] 10.222.0.117 () {56 vars in 1148 bytes} [Mon Jan 24 16:38:44 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:44.613300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eb1e8-3dd3-4847-834b-671b3321d56b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:44.624195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eb1e8-3dd3-4847-834b-671b3321d56b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:44.628771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c6a0b-2175-4293-9ba8-891c10d40a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:44.629985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c6a0b-2175-4293-9ba8-891c10d40a95 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:44.630271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c6a0b-2175-4293-9ba8-891c10d40a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:44.630543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c6a0b-2175-4293-9ba8-891c10d40a95 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:44.631328 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c6a0b-2175-4293-9ba8-891c10d40a95 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:44.632913 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c6a0b-2175-4293-9ba8-891c10d40a95 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:44.650013 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 500/1009] 10.222.0.117 () {60 vars in 1170 bytes} [Mon Jan 24 16:38:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:38:45.038099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bde72-ce84-45e8-87b6-3b65aea624b8 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.038476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bde72-ce84-45e8-87b6-3b65aea624b8 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.038720 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bde72-ce84-45e8-87b6-3b65aea624b8 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.040590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 510/1010] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:45.045800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675bf9-6116-4653-b73d-78adeb1c0c2c None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.046085 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675bf9-6116-4653-b73d-78adeb1c0c2c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.046359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675bf9-6116-4653-b73d-78adeb1c0c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.064370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-26675bf9-6116-4653-b73d-78adeb1c0c2c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:45.065532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-26675bf9-6116-4653-b73d-78adeb1c0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:45.082117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 501/1011] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:45 2022] POST /identity/v3/auth/tokens => generated 2675 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:45.103410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab46253-d793-445f-a82c-cc6021bdb19c None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.103777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab46253-d793-445f-a82c-cc6021bdb19c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.104127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab46253-d793-445f-a82c-cc6021bdb19c None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.105969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 511/1012] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:45.106334 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26675bf9-6116-4653-b73d-78adeb1c0c2c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:45.110950 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae58b1-1073-409c-b9dd-b5f1020f3a2e None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.111240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae58b1-1073-409c-b9dd-b5f1020f3a2e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.111517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae58b1-1073-409c-b9dd-b5f1020f3a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.116223 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26675bf9-6116-4653-b73d-78adeb1c0c2c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:45.120830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163b1c-3a32-4028-86dd-9d34c2acde26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:45.121609 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163b1c-3a32-4028-86dd-9d34c2acde26 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.121893 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163b1c-3a32-4028-86dd-9d34c2acde26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.122167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163b1c-3a32-4028-86dd-9d34c2acde26 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.122877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79163b1c-3a32-4028-86dd-9d34c2acde26 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:45.124477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79163b1c-3a32-4028-86dd-9d34c2acde26 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:45.131230 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-33ae58b1-1073-409c-b9dd-b5f1020f3a2e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:45.134985 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-33ae58b1-1073-409c-b9dd-b5f1020f3a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:45.135443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-79163b1c-3a32-4028-86dd-9d34c2acde26 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 24 16:38:45.136911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 502/1013] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:45.142367 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163b1c-3a32-4028-86dd-9d34c2acde26 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:45.147678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 512/1014] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:45 2022] POST /identity/v3/auth/tokens => generated 2675 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:38:45.152078 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163b1c-3a32-4028-86dd-9d34c2acde26 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:45.157697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183db24-ea63-4929-bd52-49de2722d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:45.158331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183db24-ea63-4929-bd52-49de2722d401 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.158617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183db24-ea63-4929-bd52-49de2722d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.158942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183db24-ea63-4929-bd52-49de2722d401 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.159663 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183db24-ea63-4929-bd52-49de2722d401 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:45.159972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183db24-ea63-4929-bd52-49de2722d401 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:45.163200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183db24-ea63-4929-bd52-49de2722d401 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:45.170779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 503/1015] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:45 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:45.173255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae58b1-1073-409c-b9dd-b5f1020f3a2e None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:45.175757 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183db24-ea63-4929-bd52-49de2722d401 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:45.183917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae58b1-1073-409c-b9dd-b5f1020f3a2e None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:45.185768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183db24-ea63-4929-bd52-49de2722d401 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:45.188440 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080983d-a5e6-402f-84f4-3da8f7539afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:45.189074 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080983d-a5e6-402f-84f4-3da8f7539afb admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.189352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080983d-a5e6-402f-84f4-3da8f7539afb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.189619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080983d-a5e6-402f-84f4-3da8f7539afb admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.190322 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080983d-a5e6-402f-84f4-3da8f7539afb admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:45.190491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c232b9-3314-4ec3-86a8-f119d3bd284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:45.190658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080983d-a5e6-402f-84f4-3da8f7539afb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:45.191314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c232b9-3314-4ec3-86a8-f119d3bd284e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.191649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c232b9-3314-4ec3-86a8-f119d3bd284e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.192373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c232b9-3314-4ec3-86a8-f119d3bd284e admin admin] PATH_INFO: `/v3/services/image` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.192490 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080983d-a5e6-402f-84f4-3da8f7539afb admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:45.192572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c232b9-3314-4ec3-86a8-f119d3bd284e admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:45.194121 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c232b9-3314-4ec3-86a8-f119d3bd284e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:45.197082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 513/1016] 10.222.0.117 () {56 vars in 1138 bytes} [Mon Jan 24 16:38:45 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:45.202637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080983d-a5e6-402f-84f4-3da8f7539afb admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:45.204789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-93c232b9-3314-4ec3-86a8-f119d3bd284e admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 24 16:38:45.206823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 504/1017] 10.222.0.117 () {56 vars in 1131 bytes} [Mon Jan 24 16:38:45 2022] GET /identity/v3/services/image => generated 86 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:45.212175 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c232b9-3314-4ec3-86a8-f119d3bd284e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:45.216228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080983d-a5e6-402f-84f4-3da8f7539afb admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:45.220937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c96aed-ab1b-49bb-92c2-0acff45a6e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:45.221555 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c96aed-ab1b-49bb-92c2-0acff45a6e20 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.221753 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c232b9-3314-4ec3-86a8-f119d3bd284e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:45.221854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c96aed-ab1b-49bb-92c2-0acff45a6e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.222088 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c96aed-ab1b-49bb-92c2-0acff45a6e20 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.223366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c96aed-ab1b-49bb-92c2-0acff45a6e20 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:45.224908 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c96aed-ab1b-49bb-92c2-0acff45a6e20 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:45.227443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497238c-59e0-41ff-8f7b-647b1669b242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:45.228054 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497238c-59e0-41ff-8f7b-647b1669b242 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.228356 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497238c-59e0-41ff-8f7b-647b1669b242 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.228610 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497238c-59e0-41ff-8f7b-647b1669b242 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.229315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497238c-59e0-41ff-8f7b-647b1669b242 admin admin] RBAC: Adding query filter params (name=image) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:45.229621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497238c-59e0-41ff-8f7b-647b1669b242 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:45.231210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497238c-59e0-41ff-8f7b-647b1669b242 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:45.242513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 505/1018] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:45 2022] GET /identity/v3/services?name=image => generated 123 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:45.243406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497238c-59e0-41ff-8f7b-647b1669b242 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:45.246075 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 514/1019] 10.222.0.117 () {60 vars in 1170 bytes} [Mon Jan 24 16:38:45 2022] POST /identity/v3/endpoints => generated 336 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:45.253529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497238c-59e0-41ff-8f7b-647b1669b242 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:45.271684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5b4e-7e39-44de-9427-2cce825d3b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:45.272726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5b4e-7e39-44de-9427-2cce825d3b74 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.273154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5b4e-7e39-44de-9427-2cce825d3b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.273660 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5b4e-7e39-44de-9427-2cce825d3b74 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.274596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb5b4e-7e39-44de-9427-2cce825d3b74 admin admin] RBAC: Adding query filter params (type=image) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:45.275088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb5b4e-7e39-44de-9427-2cce825d3b74 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:45.276966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb5b4e-7e39-44de-9427-2cce825d3b74 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:45.283058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 506/1020] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:45 2022] GET /identity/v3/services?type=image => generated 352 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:45.290374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c96aed-ab1b-49bb-92c2-0acff45a6e20 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:45.301583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c96aed-ab1b-49bb-92c2-0acff45a6e20 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:45.306557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ff2cc-6c06-4881-90c6-72dbefc601ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:45.307272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ff2cc-6c06-4881-90c6-72dbefc601ba admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.307560 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ff2cc-6c06-4881-90c6-72dbefc601ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.307839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ff2cc-6c06-4881-90c6-72dbefc601ba admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.308659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ff2cc-6c06-4881-90c6-72dbefc601ba admin admin] RBAC: Adding query filter params (interface=public, service_id=925c2c2ee2ed45b6a464767dacdb5aae, region_id=RegionOne) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:45.308972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ff2cc-6c06-4881-90c6-72dbefc601ba admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:45.310592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ff2cc-6c06-4881-90c6-72dbefc601ba admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:45.321326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 515/1021] 10.222.0.117 () {56 vars in 1277 bytes} [Mon Jan 24 16:38:45 2022] GET /identity/v3/endpoints?service_id=925c2c2ee2ed45b6a464767dacdb5aae&interface=public®ion_id=RegionOne => generated 195 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:45.322437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5b4e-7e39-44de-9427-2cce825d3b74 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:45.332800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5b4e-7e39-44de-9427-2cce825d3b74 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:45.339293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc15da-855a-48b8-9524-670e49647f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:45.340157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc15da-855a-48b8-9524-670e49647f2c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:45.340437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc15da-855a-48b8-9524-670e49647f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:45.340798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc15da-855a-48b8-9524-670e49647f2c admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:45.341655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc15da-855a-48b8-9524-670e49647f2c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:45.343602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc15da-855a-48b8-9524-670e49647f2c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:45.352010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 507/1022] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:38:45 2022] GET /identity/v3/services => generated 1966 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:38:46.933335 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d93b3-47ae-4af0-8ba7-59f5380863d9 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:46.933855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d93b3-47ae-4af0-8ba7-59f5380863d9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:46.933931 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d93b3-47ae-4af0-8ba7-59f5380863d9 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:46.935728 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 516/1023] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:46.941235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bf030-292e-47e0-9902-40ecae71223e None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:46.941872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bf030-292e-47e0-9902-40ecae71223e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:46.941872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bf030-292e-47e0-9902-40ecae71223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:46.960322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-475bf030-292e-47e0-9902-40ecae71223e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:46.961516 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-475bf030-292e-47e0-9902-40ecae71223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:46.969368 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 508/1024] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:46 2022] POST /identity/v3/auth/tokens => generated 2832 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:38:46.993957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d93b3-47ae-4af0-8ba7-59f5380863d9 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:47.006645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d93b3-47ae-4af0-8ba7-59f5380863d9 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:47.011053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe31b3a-4a39-4598-989c-e656fd216713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:47.011814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31b3a-4a39-4598-989c-e656fd216713 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.012092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31b3a-4a39-4598-989c-e656fd216713 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.012363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31b3a-4a39-4598-989c-e656fd216713 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.013517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe31b3a-4a39-4598-989c-e656fd216713 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:47.015194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe31b3a-4a39-4598-989c-e656fd216713 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:47.016896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 517/1025] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:46 2022] GET /identity/v3/domains/default => generated 200 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:47.022991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bf030-292e-47e0-9902-40ecae71223e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:47.032162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bf030-292e-47e0-9902-40ecae71223e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:47.037882 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904da739-cd3b-4fea-aad7-07009f096d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:47.038533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da739-cd3b-4fea-aad7-07009f096d6f admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.038846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da739-cd3b-4fea-aad7-07009f096d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.039121 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da739-cd3b-4fea-aad7-07009f096d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.039859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904da739-cd3b-4fea-aad7-07009f096d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:47.041747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904da739-cd3b-4fea-aad7-07009f096d6f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:47.068611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 509/1026] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:38:47 2022] POST /identity/v3/projects => generated 312 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:47.596874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796f342-d93b-4072-9096-1b6c47cce237 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.597281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796f342-d93b-4072-9096-1b6c47cce237 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.597456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796f342-d93b-4072-9096-1b6c47cce237 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.599513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 518/1027] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:47.604791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ff0d4-0a2e-4e98-8f74-07247100e71a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.605077 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ff0d4-0a2e-4e98-8f74-07247100e71a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.605349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ff0d4-0a2e-4e98-8f74-07247100e71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.622674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-795ff0d4-0a2e-4e98-8f74-07247100e71a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:47.623872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-795ff0d4-0a2e-4e98-8f74-07247100e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:47.640218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231cf6c-e797-4a3b-8732-bc987e88de36 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.640491 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231cf6c-e797-4a3b-8732-bc987e88de36 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.640764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231cf6c-e797-4a3b-8732-bc987e88de36 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.642515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 519/1028] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:38:47.648451 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd5e54-e6c5-476e-a390-f9b64951bd31 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.648730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd5e54-e6c5-476e-a390-f9b64951bd31 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.648999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd5e54-e6c5-476e-a390-f9b64951bd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.666515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f2cd5e54-e6c5-476e-a390-f9b64951bd31 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:47.667720 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f2cd5e54-e6c5-476e-a390-f9b64951bd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:47.683804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 510/1029] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:47 2022] POST /identity/v3/auth/tokens => generated 2832 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:47.707393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ff0d4-0a2e-4e98-8f74-07247100e71a None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:47.716035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ff0d4-0a2e-4e98-8f74-07247100e71a None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:47.720464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c19d8-6304-4a99-bb31-a68f35761530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:47.721229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c19d8-6304-4a99-bb31-a68f35761530 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.721510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c19d8-6304-4a99-bb31-a68f35761530 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.721786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c19d8-6304-4a99-bb31-a68f35761530 admin admin] PATH_INFO: `/v3/services/image` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.722448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c19d8-6304-4a99-bb31-a68f35761530 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:47.723842 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 520/1030] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:47 2022] POST /identity/v3/auth/tokens => generated 2832 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:38:47.724215 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c19d8-6304-4a99-bb31-a68f35761530 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:47.735024 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-107c19d8-6304-4a99-bb31-a68f35761530 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 24 16:38:47.736247 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 511/1031] 10.222.0.117 () {56 vars in 1131 bytes} [Mon Jan 24 16:38:47 2022] GET /identity/v3/services/image => generated 86 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:47.742705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd5e54-e6c5-476e-a390-f9b64951bd31 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:47.747874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c19d8-6304-4a99-bb31-a68f35761530 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:47.751999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd5e54-e6c5-476e-a390-f9b64951bd31 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:47.757112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8669e6-46d0-42c8-b51f-1ccaca727efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:47.757852 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8669e6-46d0-42c8-b51f-1ccaca727efa admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.758136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8669e6-46d0-42c8-b51f-1ccaca727efa admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.758407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8669e6-46d0-42c8-b51f-1ccaca727efa admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.759027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c19d8-6304-4a99-bb31-a68f35761530 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:47.759190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8669e6-46d0-42c8-b51f-1ccaca727efa admin admin] RBAC: Adding query filter params (name=image) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:47.759448 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8669e6-46d0-42c8-b51f-1ccaca727efa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:47.761036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8669e6-46d0-42c8-b51f-1ccaca727efa admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:47.763629 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f747b1f-ee8d-4044-9ad4-decca4a09871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:47.764418 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f747b1f-ee8d-4044-9ad4-decca4a09871 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.764701 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f747b1f-ee8d-4044-9ad4-decca4a09871 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.764978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f747b1f-ee8d-4044-9ad4-decca4a09871 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.766923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 521/1032] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:47 2022] GET /identity/v3/services?name=image => generated 123 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:47.771819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8669e6-46d0-42c8-b51f-1ccaca727efa admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:47.777582 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f747b1f-ee8d-4044-9ad4-decca4a09871 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:47.781028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8669e6-46d0-42c8-b51f-1ccaca727efa admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:47.784902 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-9f747b1f-ee8d-4044-9ad4-decca4a09871 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 24 16:38:47.790814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2db676-156f-49a3-95b4-2310159366c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:47.790988 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 512/1033] 10.222.0.117 () {56 vars in 1146 bytes} [Mon Jan 24 16:38:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:47.791091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2db676-156f-49a3-95b4-2310159366c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.791091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2db676-156f-49a3-95b4-2310159366c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.791091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2db676-156f-49a3-95b4-2310159366c9 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.791091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2db676-156f-49a3-95b4-2310159366c9 admin admin] RBAC: Adding query filter params (type=image) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:47.791091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2db676-156f-49a3-95b4-2310159366c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:47.791091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2db676-156f-49a3-95b4-2310159366c9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:47.791861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f747b1f-ee8d-4044-9ad4-decca4a09871 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:47.795591 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 522/1034] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:47 2022] GET /identity/v3/services?type=image => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:47.801619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2db676-156f-49a3-95b4-2310159366c9 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:47.805621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f747b1f-ee8d-4044-9ad4-decca4a09871 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:47.810179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f89a3-a740-4e38-b646-5329b485125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:47.810860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f89a3-a740-4e38-b646-5329b485125a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.811052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2db676-156f-49a3-95b4-2310159366c9 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:47.811154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f89a3-a740-4e38-b646-5329b485125a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.811406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f89a3-a740-4e38-b646-5329b485125a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.812172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f89a3-a740-4e38-b646-5329b485125a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:47.812478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f89a3-a740-4e38-b646-5329b485125a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:47.814091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f89a3-a740-4e38-b646-5329b485125a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:47.815573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c049ca-9602-4122-9599-23095f959227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:47.817144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c049ca-9602-4122-9599-23095f959227 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.817144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c049ca-9602-4122-9599-23095f959227 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.817593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c049ca-9602-4122-9599-23095f959227 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.818334 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c049ca-9602-4122-9599-23095f959227 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:47.819915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c049ca-9602-4122-9599-23095f959227 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:47.828368 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 513/1035] 10.222.0.117 () {56 vars in 1141 bytes} [Mon Jan 24 16:38:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:47.829508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f89a3-a740-4e38-b646-5329b485125a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:47.841387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f89a3-a740-4e38-b646-5329b485125a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:47.842064 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 523/1036] 10.222.0.117 () {60 vars in 1170 bytes} [Mon Jan 24 16:38:47 2022] POST /identity/v3/endpoints => generated 329 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:38:47.858708 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139805-34f6-4543-a031-e9fdf8c616b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:47.859488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139805-34f6-4543-a031-e9fdf8c616b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.859768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139805-34f6-4543-a031-e9fdf8c616b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.860098 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139805-34f6-4543-a031-e9fdf8c616b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.874227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71139805-34f6-4543-a031-e9fdf8c616b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:47.876212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71139805-34f6-4543-a031-e9fdf8c616b0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:47.896351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-71139805-34f6-4543-a031-e9fdf8c616b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:47.902326 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 514/1037] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:47.904144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c049ca-9602-4122-9599-23095f959227 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:47.916149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c049ca-9602-4122-9599-23095f959227 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:47.921847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e818-be86-4633-bb49-82019358e9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:47.922532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e818-be86-4633-bb49-82019358e9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.922849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e818-be86-4633-bb49-82019358e9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.923153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e818-be86-4633-bb49-82019358e9b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.923880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e818-be86-4633-bb49-82019358e9b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:47.924187 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e818-be86-4633-bb49-82019358e9b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:47.925879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e818-be86-4633-bb49-82019358e9b7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:47.943870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 524/1038] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:47.946029 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139805-34f6-4543-a031-e9fdf8c616b0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:47.956116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139805-34f6-4543-a031-e9fdf8c616b0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:47.961448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331f940-d4fc-484f-be1e-396327ece17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:47.962280 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331f940-d4fc-484f-be1e-396327ece17f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:47.962559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331f940-d4fc-484f-be1e-396327ece17f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:47.962865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331f940-d4fc-484f-be1e-396327ece17f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:47.972530 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331f940-d4fc-484f-be1e-396327ece17f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:47.975909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331f940-d4fc-484f-be1e-396327ece17f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:47.991188 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-b331f940-d4fc-484f-be1e-396327ece17f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 24 16:38:47.992639 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 515/1039] 10.222.0.117 () {56 vars in 1119 bytes} [Mon Jan 24 16:38:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:47.998701 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e818-be86-4633-bb49-82019358e9b7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:48.008915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e818-be86-4633-bb49-82019358e9b7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:48.013688 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef44fd-0c68-493c-9928-0948b336f545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:48.014350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef44fd-0c68-493c-9928-0948b336f545 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:48.014632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef44fd-0c68-493c-9928-0948b336f545 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:48.014933 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef44fd-0c68-493c-9928-0948b336f545 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:48.015782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef44fd-0c68-493c-9928-0948b336f545 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:48.016089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef44fd-0c68-493c-9928-0948b336f545 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:48.017931 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef44fd-0c68-493c-9928-0948b336f545 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:48.037467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 525/1040] 10.222.0.117 () {56 vars in 1159 bytes} [Mon Jan 24 16:38:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:48.043514 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331f940-d4fc-484f-be1e-396327ece17f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:48.053605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331f940-d4fc-484f-be1e-396327ece17f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:48.059306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dd2ec-98ea-4fb5-b338-efb215056db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:48.059945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dd2ec-98ea-4fb5-b338-efb215056db9 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:48.060220 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dd2ec-98ea-4fb5-b338-efb215056db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:48.060490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dd2ec-98ea-4fb5-b338-efb215056db9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:48.069538 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dd2ec-98ea-4fb5-b338-efb215056db9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:48.071339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dd2ec-98ea-4fb5-b338-efb215056db9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:48.080185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 516/1041] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:48 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:38:48.086808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef44fd-0c68-493c-9928-0948b336f545 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:48.096389 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef44fd-0c68-493c-9928-0948b336f545 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:48.101428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8876b8-9893-4daf-beb5-6f6613546b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:48.102195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8876b8-9893-4daf-beb5-6f6613546b7f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:48.102471 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8876b8-9893-4daf-beb5-6f6613546b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:48.102735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8876b8-9893-4daf-beb5-6f6613546b7f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:48.112964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8876b8-9893-4daf-beb5-6f6613546b7f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:48.114997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8876b8-9893-4daf-beb5-6f6613546b7f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:48.133194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-7d8876b8-9893-4daf-beb5-6f6613546b7f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:48.139708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 526/1042] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:48.141245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dd2ec-98ea-4fb5-b338-efb215056db9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:48.151083 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dd2ec-98ea-4fb5-b338-efb215056db9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:48.157644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4198657-e272-4e41-beb8-ca18159173e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:48.158287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4198657-e272-4e41-beb8-ca18159173e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:48.158565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4198657-e272-4e41-beb8-ca18159173e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:48.158863 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4198657-e272-4e41-beb8-ca18159173e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:48.159596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4198657-e272-4e41-beb8-ca18159173e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:48.159894 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4198657-e272-4e41-beb8-ca18159173e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:48.161508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4198657-e272-4e41-beb8-ca18159173e2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:48.178209 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 517/1043] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:48.179636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8876b8-9893-4daf-beb5-6f6613546b7f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:48.189370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8876b8-9893-4daf-beb5-6f6613546b7f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:48.194781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f38977-fb63-47da-a1f5-0048e9231fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:48.195683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38977-fb63-47da-a1f5-0048e9231fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:48.196070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38977-fb63-47da-a1f5-0048e9231fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:48.196436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38977-fb63-47da-a1f5-0048e9231fe0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:48.203679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f38977-fb63-47da-a1f5-0048e9231fe0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:48.205639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f38977-fb63-47da-a1f5-0048e9231fe0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:48.219452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-33f38977-fb63-47da-a1f5-0048e9231fe0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:48.226264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 527/1044] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:48.227818 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4198657-e272-4e41-beb8-ca18159173e2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:48.238987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4198657-e272-4e41-beb8-ca18159173e2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:48.243648 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360c1f1-b911-4765-aac5-81bcb0a18e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:48.244387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360c1f1-b911-4765-aac5-81bcb0a18e20 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:48.244727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360c1f1-b911-4765-aac5-81bcb0a18e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:48.245063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360c1f1-b911-4765-aac5-81bcb0a18e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:48.246064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360c1f1-b911-4765-aac5-81bcb0a18e20 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:48.246433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360c1f1-b911-4765-aac5-81bcb0a18e20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:48.248397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360c1f1-b911-4765-aac5-81bcb0a18e20 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:48.262075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 518/1045] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:48.268128 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f38977-fb63-47da-a1f5-0048e9231fe0 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:48.280291 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f38977-fb63-47da-a1f5-0048e9231fe0 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:48.285931 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5691e-c8f7-479b-859a-c77d2b0e178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:48.286664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5691e-c8f7-479b-859a-c77d2b0e178f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:48.286974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5691e-c8f7-479b-859a-c77d2b0e178f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:48.287244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5691e-c8f7-479b-859a-c77d2b0e178f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:48.288101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5691e-c8f7-479b-859a-c77d2b0e178f admin admin] RBAC: Adding query filter params (role.id=62fba91cbca741d1a684f0a9987d388b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=37c91fefe89a45b48df82a311e771ea3) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:48.288417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5691e-c8f7-479b-859a-c77d2b0e178f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:48.290248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5691e-c8f7-479b-859a-c77d2b0e178f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:48.302861 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 528/1046] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:48 2022] GET /identity/v3/role_assignments?user.id=37c91fefe89a45b48df82a311e771ea3&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=62fba91cbca741d1a684f0a9987d388b => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:49.531079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1ad41-36b9-4310-8a1a-7b75eec1b86c None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:49.531593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1ad41-36b9-4310-8a1a-7b75eec1b86c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:49.531593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1ad41-36b9-4310-8a1a-7b75eec1b86c None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:49.533305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 519/1047] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:49.539493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba517699-c7ae-4c42-9273-2097b42a3066 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:49.539888 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba517699-c7ae-4c42-9273-2097b42a3066 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:49.540051 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba517699-c7ae-4c42-9273-2097b42a3066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:49.559868 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ba517699-c7ae-4c42-9273-2097b42a3066 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:49.561052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ba517699-c7ae-4c42-9273-2097b42a3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:49.569245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 529/1048] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:49 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:49.595013 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1ad41-36b9-4310-8a1a-7b75eec1b86c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:49.607826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1ad41-36b9-4310-8a1a-7b75eec1b86c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:49.612127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e206f39-2632-441c-adc9-e0d69573dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:49.612893 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e206f39-2632-441c-adc9-e0d69573dbea admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:49.613201 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e206f39-2632-441c-adc9-e0d69573dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:49.613471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e206f39-2632-441c-adc9-e0d69573dbea admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:49.614646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e206f39-2632-441c-adc9-e0d69573dbea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:49.616341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e206f39-2632-441c-adc9-e0d69573dbea admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:49.617931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 520/1049] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:49 2022] GET /identity/v3/domains/default => generated 200 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:49.623457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba517699-c7ae-4c42-9273-2097b42a3066 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:49.633221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba517699-c7ae-4c42-9273-2097b42a3066 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:49.637671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f4c16-5ff6-4928-8ba2-acff68b8b521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:49.638318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f4c16-5ff6-4928-8ba2-acff68b8b521 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:49.638592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f4c16-5ff6-4928-8ba2-acff68b8b521 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:49.638890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f4c16-5ff6-4928-8ba2-acff68b8b521 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:49.639618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f4c16-5ff6-4928-8ba2-acff68b8b521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:49.641490 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f4c16-5ff6-4928-8ba2-acff68b8b521 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:49.662220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 530/1050] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:38:49 2022] POST /identity/v3/users => generated 286 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:38:50.129565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a67792-fb87-42dd-ad76-969ed7833ece None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.129852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a67792-fb87-42dd-ad76-969ed7833ece None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.130286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a67792-fb87-42dd-ad76-969ed7833ece None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.134855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 521/1051] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:50.137870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420767ee-95b5-4ac7-8212-cb6670973215 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.138162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420767ee-95b5-4ac7-8212-cb6670973215 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.138444 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420767ee-95b5-4ac7-8212-cb6670973215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.272655 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-420767ee-95b5-4ac7-8212-cb6670973215 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:50.273852 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-420767ee-95b5-4ac7-8212-cb6670973215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:50.281731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 531/1052] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:50 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:50.304959 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a67792-fb87-42dd-ad76-969ed7833ece None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:50.317789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a67792-fb87-42dd-ad76-969ed7833ece None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:50.322130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c82d1-ad21-4664-830c-01ede705fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:50.322779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c82d1-ad21-4664-830c-01ede705fee3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.323104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c82d1-ad21-4664-830c-01ede705fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.323382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c82d1-ad21-4664-830c-01ede705fee3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.331246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c82d1-ad21-4664-830c-01ede705fee3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:50.333623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c82d1-ad21-4664-830c-01ede705fee3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:50.349050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 522/1053] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:50 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:38:50.355177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420767ee-95b5-4ac7-8212-cb6670973215 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:50.365253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420767ee-95b5-4ac7-8212-cb6670973215 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:50.370017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa0b16-130a-4005-954b-7cb51ed7f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:50.370870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa0b16-130a-4005-954b-7cb51ed7f0ed admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.371156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa0b16-130a-4005-954b-7cb51ed7f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.371430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa0b16-130a-4005-954b-7cb51ed7f0ed admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.372710 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa0b16-130a-4005-954b-7cb51ed7f0ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:50.374462 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa0b16-130a-4005-954b-7cb51ed7f0ed admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:50.376384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 532/1054] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:50 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:50.617322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414940c-404f-40ba-a7c9-833cc22eeb2f None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.617834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414940c-404f-40ba-a7c9-833cc22eeb2f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.617917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414940c-404f-40ba-a7c9-833cc22eeb2f None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.619696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 523/1055] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:50.624844 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650a8a0-bdd8-4e52-9a92-1686e7bca8b6 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.625293 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650a8a0-bdd8-4e52-9a92-1686e7bca8b6 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.625382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650a8a0-bdd8-4e52-9a92-1686e7bca8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.644139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-2650a8a0-bdd8-4e52-9a92-1686e7bca8b6 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:50.645929 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2650a8a0-bdd8-4e52-9a92-1686e7bca8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:50.654084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 533/1056] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:50 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:50.678215 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414940c-404f-40ba-a7c9-833cc22eeb2f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:50.690398 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414940c-404f-40ba-a7c9-833cc22eeb2f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:50.694900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f36147-ea23-4e75-857a-ab253a679c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:50.695691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f36147-ea23-4e75-857a-ab253a679c91 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.695975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f36147-ea23-4e75-857a-ab253a679c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.696273 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f36147-ea23-4e75-857a-ab253a679c91 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.707389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f36147-ea23-4e75-857a-ab253a679c91 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:50.714525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-07f36147-ea23-4e75-857a-ab253a679c91 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 24 16:38:50.715720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 524/1057] 10.222.0.117 () {56 vars in 1146 bytes} [Mon Jan 24 16:38:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:50.721906 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650a8a0-bdd8-4e52-9a92-1686e7bca8b6 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:50.731741 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650a8a0-bdd8-4e52-9a92-1686e7bca8b6 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:50.736235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aad6e7-2ef8-4c83-9715-4648b05ca7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:50.736881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad6e7-2ef8-4c83-9715-4648b05ca7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.737162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad6e7-2ef8-4c83-9715-4648b05ca7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.737435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad6e7-2ef8-4c83-9715-4648b05ca7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.738224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aad6e7-2ef8-4c83-9715-4648b05ca7b6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:50.738529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aad6e7-2ef8-4c83-9715-4648b05ca7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:50.740159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aad6e7-2ef8-4c83-9715-4648b05ca7b6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:50.748524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 534/1058] 10.222.0.117 () {56 vars in 1141 bytes} [Mon Jan 24 16:38:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:50.754413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f36147-ea23-4e75-857a-ab253a679c91 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:50.764261 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f36147-ea23-4e75-857a-ab253a679c91 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:50.768778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04740c-cd7d-4bc3-a5a2-a1a2c1b5d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:50.770074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04740c-cd7d-4bc3-a5a2-a1a2c1b5d512 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.770360 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04740c-cd7d-4bc3-a5a2-a1a2c1b5d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.770631 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04740c-cd7d-4bc3-a5a2-a1a2c1b5d512 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.780946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04740c-cd7d-4bc3-a5a2-a1a2c1b5d512 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:50.782817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04740c-cd7d-4bc3-a5a2-a1a2c1b5d512 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:50.799384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-1f04740c-cd7d-4bc3-a5a2-a1a2c1b5d512 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:50.802166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 525/1059] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:50.806936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aad6e7-2ef8-4c83-9715-4648b05ca7b6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:50.817044 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aad6e7-2ef8-4c83-9715-4648b05ca7b6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:50.821559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc609481-4488-497d-8a3d-5e212e0d10d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:50.822204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc609481-4488-497d-8a3d-5e212e0d10d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.822486 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc609481-4488-497d-8a3d-5e212e0d10d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.822786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc609481-4488-497d-8a3d-5e212e0d10d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.823527 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc609481-4488-497d-8a3d-5e212e0d10d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:50.823835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc609481-4488-497d-8a3d-5e212e0d10d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:50.825420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc609481-4488-497d-8a3d-5e212e0d10d9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:50.843495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 535/1060] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:50.844713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04740c-cd7d-4bc3-a5a2-a1a2c1b5d512 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:50.855557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04740c-cd7d-4bc3-a5a2-a1a2c1b5d512 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:50.860103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb7014-31fd-4433-bd55-721f7c0c4c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:50.860880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb7014-31fd-4433-bd55-721f7c0c4c29 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.861165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb7014-31fd-4433-bd55-721f7c0c4c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.861444 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb7014-31fd-4433-bd55-721f7c0c4c29 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.873457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb7014-31fd-4433-bd55-721f7c0c4c29 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:50.877252 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb7014-31fd-4433-bd55-721f7c0c4c29 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:50.892383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-29bb7014-31fd-4433-bd55-721f7c0c4c29 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 24 16:38:50.893510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 526/1061] 10.222.0.117 () {56 vars in 1119 bytes} [Mon Jan 24 16:38:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:50.899483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc609481-4488-497d-8a3d-5e212e0d10d9 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:50.909001 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc609481-4488-497d-8a3d-5e212e0d10d9 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:50.913681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11fa2b-966e-4810-8ad2-695c7ca7c281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:50.914391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11fa2b-966e-4810-8ad2-695c7ca7c281 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.914775 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11fa2b-966e-4810-8ad2-695c7ca7c281 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.915125 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11fa2b-966e-4810-8ad2-695c7ca7c281 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.916008 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11fa2b-966e-4810-8ad2-695c7ca7c281 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:50.916376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11fa2b-966e-4810-8ad2-695c7ca7c281 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:50.918248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11fa2b-966e-4810-8ad2-695c7ca7c281 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:50.935750 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 536/1062] 10.222.0.117 () {56 vars in 1159 bytes} [Mon Jan 24 16:38:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:50.942017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb7014-31fd-4433-bd55-721f7c0c4c29 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:50.951564 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb7014-31fd-4433-bd55-721f7c0c4c29 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:50.955945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7e63-b41e-4467-8b7b-3251f7fc38de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:50.956701 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7e63-b41e-4467-8b7b-3251f7fc38de admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:50.957045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7e63-b41e-4467-8b7b-3251f7fc38de admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:50.957399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7e63-b41e-4467-8b7b-3251f7fc38de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:50.967311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e7e63-b41e-4467-8b7b-3251f7fc38de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:50.969100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e7e63-b41e-4467-8b7b-3251f7fc38de admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:50.985343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-304e7e63-b41e-4467-8b7b-3251f7fc38de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:50.986483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 527/1063] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:50.992514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11fa2b-966e-4810-8ad2-695c7ca7c281 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:51.002082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11fa2b-966e-4810-8ad2-695c7ca7c281 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:51.007259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab17025-c41d-4d5e-9247-0f4eb66d0af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:51.007901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17025-c41d-4d5e-9247-0f4eb66d0af1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:51.008183 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17025-c41d-4d5e-9247-0f4eb66d0af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:51.008456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17025-c41d-4d5e-9247-0f4eb66d0af1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:51.009183 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab17025-c41d-4d5e-9247-0f4eb66d0af1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:51.009487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab17025-c41d-4d5e-9247-0f4eb66d0af1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:51.011072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab17025-c41d-4d5e-9247-0f4eb66d0af1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:51.022019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 537/1064] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:51.027220 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7e63-b41e-4467-8b7b-3251f7fc38de admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:51.037233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7e63-b41e-4467-8b7b-3251f7fc38de admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:51.041737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef899886-0af8-401d-8b68-77635c4cd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:51.042492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899886-0af8-401d-8b68-77635c4cd774 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:51.042802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899886-0af8-401d-8b68-77635c4cd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:51.043086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899886-0af8-401d-8b68-77635c4cd774 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:51.049738 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef899886-0af8-401d-8b68-77635c4cd774 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:51.052292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef899886-0af8-401d-8b68-77635c4cd774 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:51.064949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-ef899886-0af8-401d-8b68-77635c4cd774 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:51.066289 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 528/1065] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:51.071978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab17025-c41d-4d5e-9247-0f4eb66d0af1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:51.081437 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab17025-c41d-4d5e-9247-0f4eb66d0af1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:51.086552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ff228-c160-4da1-b995-88bd2dd3275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:51.087214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ff228-c160-4da1-b995-88bd2dd3275b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:51.087498 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ff228-c160-4da1-b995-88bd2dd3275b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:51.087774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ff228-c160-4da1-b995-88bd2dd3275b admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:51.088562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ff228-c160-4da1-b995-88bd2dd3275b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:51.088869 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ff228-c160-4da1-b995-88bd2dd3275b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:51.090693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ff228-c160-4da1-b995-88bd2dd3275b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:51.103409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 538/1066] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:51.109088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef899886-0af8-401d-8b68-77635c4cd774 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:51.120724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef899886-0af8-401d-8b68-77635c4cd774 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:51.125601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68425b74-9a31-4b49-96f0-5fa9447b92ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:51.126500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68425b74-9a31-4b49-96f0-5fa9447b92ab admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:51.126807 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68425b74-9a31-4b49-96f0-5fa9447b92ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:51.127088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68425b74-9a31-4b49-96f0-5fa9447b92ab admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/37c91fefe89a45b48df82a311e771ea3/roles/62fba91cbca741d1a684f0a9987d388b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:51.129437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68425b74-9a31-4b49-96f0-5fa9447b92ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=37c91fefe89a45b48df82a311e771ea3, role_id=62fba91cbca741d1a684f0a9987d388b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:51.132124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68425b74-9a31-4b49-96f0-5fa9447b92ab admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:51.146154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 529/1067] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:38:51 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/37c91fefe89a45b48df82a311e771ea3/roles/62fba91cbca741d1a684f0a9987d388b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:38:51.936837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166add0-688a-451b-b134-fb933b816b96 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:51.937464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166add0-688a-451b-b134-fb933b816b96 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:51.937464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166add0-688a-451b-b134-fb933b816b96 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:51.939195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 539/1068] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:51.944927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703472c-bd07-4b75-905e-90a364d7028a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:51.945377 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703472c-bd07-4b75-905e-90a364d7028a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:51.945476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703472c-bd07-4b75-905e-90a364d7028a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:51.963332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-0703472c-bd07-4b75-905e-90a364d7028a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:51.964499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0703472c-bd07-4b75-905e-90a364d7028a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:52.019599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 530/1069] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:51 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:52.042832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166add0-688a-451b-b134-fb933b816b96 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:52.056117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166add0-688a-451b-b134-fb933b816b96 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:52.061925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f86f25-993a-4019-b248-922801b7b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:52.062689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f86f25-993a-4019-b248-922801b7b7fe admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:52.062998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f86f25-993a-4019-b248-922801b7b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:52.063271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f86f25-993a-4019-b248-922801b7b7fe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:52.073931 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f86f25-993a-4019-b248-922801b7b7fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:52.080749 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-a0f86f25-993a-4019-b248-922801b7b7fe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:38:52.082828 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 540/1070] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:52.088389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703472c-bd07-4b75-905e-90a364d7028a None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:52.097210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703472c-bd07-4b75-905e-90a364d7028a None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:52.101999 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b756d-9f3c-4936-aebe-f3f061a048ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:52.102641 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b756d-9f3c-4936-aebe-f3f061a048ec admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:52.102953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b756d-9f3c-4936-aebe-f3f061a048ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:52.103227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b756d-9f3c-4936-aebe-f3f061a048ec admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:52.103982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b756d-9f3c-4936-aebe-f3f061a048ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:52.104282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b756d-9f3c-4936-aebe-f3f061a048ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:52.105850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b756d-9f3c-4936-aebe-f3f061a048ec admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:52.118590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 531/1071] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:52 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:52.119782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f86f25-993a-4019-b248-922801b7b7fe admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:52.130311 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f86f25-993a-4019-b248-922801b7b7fe admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:52.134842 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40d62a-a048-480b-bcd9-c1c9267313c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:52.135690 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40d62a-a048-480b-bcd9-c1c9267313c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:52.135967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40d62a-a048-480b-bcd9-c1c9267313c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:52.136237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40d62a-a048-480b-bcd9-c1c9267313c8 admin admin] PATH_INFO: `/v3/users/b9ed5dfe5c564f15b140a7b4ceb4312a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:52.150008 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40d62a-a048-480b-bcd9-c1c9267313c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9ed5dfe5c564f15b140a7b4ceb4312a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:52.152173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40d62a-a048-480b-bcd9-c1c9267313c8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:52.153881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 541/1072] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:38:52 2022] GET /identity/v3/users/b9ed5dfe5c564f15b140a7b4ceb4312a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:52.159508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b756d-9f3c-4936-aebe-f3f061a048ec admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:52.169829 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b756d-9f3c-4936-aebe-f3f061a048ec admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:52.174342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aeaa0-b218-44fb-a620-cd5119f3beea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:52.175002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aeaa0-b218-44fb-a620-cd5119f3beea admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:52.175285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aeaa0-b218-44fb-a620-cd5119f3beea admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:52.176184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aeaa0-b218-44fb-a620-cd5119f3beea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:52.184013 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5aeaa0-b218-44fb-a620-cd5119f3beea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:52.185746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5aeaa0-b218-44fb-a620-cd5119f3beea admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:52.200216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 532/1073] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:52 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:38:52.201283 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40d62a-a048-480b-bcd9-c1c9267313c8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:52.211039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40d62a-a048-480b-bcd9-c1c9267313c8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:52.215529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f936e-2e74-4a99-a2f2-40032d4975ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:52.216357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f936e-2e74-4a99-a2f2-40032d4975ca admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:52.216640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f936e-2e74-4a99-a2f2-40032d4975ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:52.216912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f936e-2e74-4a99-a2f2-40032d4975ca admin admin] PATH_INFO: `/v3/projects/acc85fd03001434da9b652de09fdaa7f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:52.218082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f936e-2e74-4a99-a2f2-40032d4975ca admin admin] RBAC: Authorizing `identity:get_project(project_id=acc85fd03001434da9b652de09fdaa7f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:52.220140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f936e-2e74-4a99-a2f2-40032d4975ca admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:52.221768 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 542/1074] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:38:52 2022] GET /identity/v3/projects/acc85fd03001434da9b652de09fdaa7f => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:52.228323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aeaa0-b218-44fb-a620-cd5119f3beea admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:52.237040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aeaa0-b218-44fb-a620-cd5119f3beea admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:52.242306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c8c48-734d-4fe3-bcee-ad2eaf4707a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:52.242984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c8c48-734d-4fe3-bcee-ad2eaf4707a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:52.243267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c8c48-734d-4fe3-bcee-ad2eaf4707a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:52.243542 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c8c48-734d-4fe3-bcee-ad2eaf4707a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:52.244402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c8c48-734d-4fe3-bcee-ad2eaf4707a4 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=acc85fd03001434da9b652de09fdaa7f, user.id=b9ed5dfe5c564f15b140a7b4ceb4312a) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:52.244715 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c8c48-734d-4fe3-bcee-ad2eaf4707a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:52.246600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c8c48-734d-4fe3-bcee-ad2eaf4707a4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:52.257503 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 533/1075] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:52 2022] GET /identity/v3/role_assignments?user.id=b9ed5dfe5c564f15b140a7b4ceb4312a&scope.project.id=acc85fd03001434da9b652de09fdaa7f&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 260 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:53.339206 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d88f6b-b25c-4013-addf-9d10d60411a3 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.339751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d88f6b-b25c-4013-addf-9d10d60411a3 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.339751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d88f6b-b25c-4013-addf-9d10d60411a3 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.341647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 543/1076] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:53.346853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380961-0250-4092-b80e-af05420227df None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.347287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380961-0250-4092-b80e-af05420227df None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.347654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380961-0250-4092-b80e-af05420227df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.366438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-62380961-0250-4092-b80e-af05420227df None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:53.367700 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-62380961-0250-4092-b80e-af05420227df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:53.375436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 534/1077] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:53 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:53.400853 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d88f6b-b25c-4013-addf-9d10d60411a3 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.413153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d88f6b-b25c-4013-addf-9d10d60411a3 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.417470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a39bf-c571-43d8-b8ff-101bedcea106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.418253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a39bf-c571-43d8-b8ff-101bedcea106 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.418535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a39bf-c571-43d8-b8ff-101bedcea106 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.418840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a39bf-c571-43d8-b8ff-101bedcea106 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.429396 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a39bf-c571-43d8-b8ff-101bedcea106 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:53.436692 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-9f3a39bf-c571-43d8-b8ff-101bedcea106 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 24 16:38:53.437835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 544/1078] 10.222.0.117 () {56 vars in 1146 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:53.444249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380961-0250-4092-b80e-af05420227df None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.453129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380961-0250-4092-b80e-af05420227df None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.458259 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf66937-2d75-4819-aa67-362469b55c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.458937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf66937-2d75-4819-aa67-362469b55c2b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.459220 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf66937-2d75-4819-aa67-362469b55c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.459495 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf66937-2d75-4819-aa67-362469b55c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.460248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf66937-2d75-4819-aa67-362469b55c2b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:53.460554 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf66937-2d75-4819-aa67-362469b55c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:53.462132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf66937-2d75-4819-aa67-362469b55c2b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:53.470008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 535/1079] 10.222.0.117 () {56 vars in 1141 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:53.475340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a39bf-c571-43d8-b8ff-101bedcea106 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.485556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a39bf-c571-43d8-b8ff-101bedcea106 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.490398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a5da-27c6-40c5-9a4c-5a3e95a0581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.491192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a5da-27c6-40c5-9a4c-5a3e95a0581d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.491474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a5da-27c6-40c5-9a4c-5a3e95a0581d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.491746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a5da-27c6-40c5-9a4c-5a3e95a0581d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.501707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398a5da-27c6-40c5-9a4c-5a3e95a0581d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:53.504093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398a5da-27c6-40c5-9a4c-5a3e95a0581d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:53.521217 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-4398a5da-27c6-40c5-9a4c-5a3e95a0581d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:53.522316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 545/1080] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:53.527726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf66937-2d75-4819-aa67-362469b55c2b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.537052 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf66937-2d75-4819-aa67-362469b55c2b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.541447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3f307-8f97-4e76-b745-35546f8d9b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.542074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3f307-8f97-4e76-b745-35546f8d9b40 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.542351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3f307-8f97-4e76-b745-35546f8d9b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.542621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3f307-8f97-4e76-b745-35546f8d9b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.543374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3f307-8f97-4e76-b745-35546f8d9b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:53.543676 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3f307-8f97-4e76-b745-35546f8d9b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:53.545244 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3f307-8f97-4e76-b745-35546f8d9b40 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:53.556354 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 536/1081] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:53.561557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a5da-27c6-40c5-9a4c-5a3e95a0581d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.571607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a5da-27c6-40c5-9a4c-5a3e95a0581d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.576032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04d5b9-0937-4d91-a9cc-f6953a3beedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.576778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d5b9-0937-4d91-a9cc-f6953a3beedd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.577059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d5b9-0937-4d91-a9cc-f6953a3beedd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.577328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d5b9-0937-4d91-a9cc-f6953a3beedd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.585523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04d5b9-0937-4d91-a9cc-f6953a3beedd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:53.587534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04d5b9-0937-4d91-a9cc-f6953a3beedd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:53.602208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-0a04d5b9-0937-4d91-a9cc-f6953a3beedd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 24 16:38:53.607493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 546/1082] 10.222.0.117 () {56 vars in 1119 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:53.608576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3f307-8f97-4e76-b745-35546f8d9b40 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.618549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3f307-8f97-4e76-b745-35546f8d9b40 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.622984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc104268-40a8-41f1-b49d-d0bbaad01cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.623616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc104268-40a8-41f1-b49d-d0bbaad01cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.623895 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc104268-40a8-41f1-b49d-d0bbaad01cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.624164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc104268-40a8-41f1-b49d-d0bbaad01cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.624992 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc104268-40a8-41f1-b49d-d0bbaad01cc0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:53.625293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc104268-40a8-41f1-b49d-d0bbaad01cc0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:53.627190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc104268-40a8-41f1-b49d-d0bbaad01cc0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:53.643721 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 537/1083] 10.222.0.117 () {56 vars in 1159 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:53.649461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04d5b9-0937-4d91-a9cc-f6953a3beedd admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.658939 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04d5b9-0937-4d91-a9cc-f6953a3beedd admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.664239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34f5f1-d252-4472-b155-fea8dd7686ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.664819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f5f1-d252-4472-b155-fea8dd7686ca admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.665099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f5f1-d252-4472-b155-fea8dd7686ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.665370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f5f1-d252-4472-b155-fea8dd7686ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.672937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34f5f1-d252-4472-b155-fea8dd7686ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:53.674658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34f5f1-d252-4472-b155-fea8dd7686ca admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:53.684173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 547/1084] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:38:53.689762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc104268-40a8-41f1-b49d-d0bbaad01cc0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.699144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc104268-40a8-41f1-b49d-d0bbaad01cc0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.703566 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6ad38-fa4a-4ba9-a2c7-c3832b5fa014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.704329 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6ad38-fa4a-4ba9-a2c7-c3832b5fa014 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.704605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6ad38-fa4a-4ba9-a2c7-c3832b5fa014 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.704875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6ad38-fa4a-4ba9-a2c7-c3832b5fa014 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.715726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6ad38-fa4a-4ba9-a2c7-c3832b5fa014 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:53.717529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6ad38-fa4a-4ba9-a2c7-c3832b5fa014 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:53.735337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-04d6ad38-fa4a-4ba9-a2c7-c3832b5fa014 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:38:53.736470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 538/1085] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:38:53.742197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34f5f1-d252-4472-b155-fea8dd7686ca admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.751013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34f5f1-d252-4472-b155-fea8dd7686ca admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.755637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf9366-c11c-4505-8373-e8b51f7b8db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.756274 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf9366-c11c-4505-8373-e8b51f7b8db7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.756552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf9366-c11c-4505-8373-e8b51f7b8db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.756823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf9366-c11c-4505-8373-e8b51f7b8db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.757547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf9366-c11c-4505-8373-e8b51f7b8db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:53.757847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf9366-c11c-4505-8373-e8b51f7b8db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:53.759448 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf9366-c11c-4505-8373-e8b51f7b8db7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:53.771348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 548/1086] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:53.776527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6ad38-fa4a-4ba9-a2c7-c3832b5fa014 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.786638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6ad38-fa4a-4ba9-a2c7-c3832b5fa014 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.791172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e65e-0131-4113-8c46-badf6eb8bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.791939 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e65e-0131-4113-8c46-badf6eb8bd63 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.792217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e65e-0131-4113-8c46-badf6eb8bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.792488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e65e-0131-4113-8c46-badf6eb8bd63 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.799222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1e65e-0131-4113-8c46-badf6eb8bd63 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:53.801147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1e65e-0131-4113-8c46-badf6eb8bd63 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:53.813651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-66d1e65e-0131-4113-8c46-badf6eb8bd63 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:38:53.814800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 539/1087] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:53.820583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf9366-c11c-4505-8373-e8b51f7b8db7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.830087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf9366-c11c-4505-8373-e8b51f7b8db7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.835399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117c7cf-86d3-442e-86f2-7d0165ed4601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.836106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c7cf-86d3-442e-86f2-7d0165ed4601 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.836457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c7cf-86d3-442e-86f2-7d0165ed4601 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.836800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c7cf-86d3-442e-86f2-7d0165ed4601 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.837674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117c7cf-86d3-442e-86f2-7d0165ed4601 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:53.837987 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117c7cf-86d3-442e-86f2-7d0165ed4601 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:53.839855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117c7cf-86d3-442e-86f2-7d0165ed4601 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:53.852668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 549/1088] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:53.858398 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e65e-0131-4113-8c46-badf6eb8bd63 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:53.868469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e65e-0131-4113-8c46-badf6eb8bd63 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:53.872901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82663439-3f48-4d45-95bf-35cf6bbdd99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:53.873518 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82663439-3f48-4d45-95bf-35cf6bbdd99d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:53.873800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82663439-3f48-4d45-95bf-35cf6bbdd99d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:53.874070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82663439-3f48-4d45-95bf-35cf6bbdd99d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:53.874961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82663439-3f48-4d45-95bf-35cf6bbdd99d admin admin] RBAC: Adding query filter params (role.id=62fba91cbca741d1a684f0a9987d388b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=37c91fefe89a45b48df82a311e771ea3) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:53.875265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82663439-3f48-4d45-95bf-35cf6bbdd99d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:53.877074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82663439-3f48-4d45-95bf-35cf6bbdd99d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:53.882671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 540/1089] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:53 2022] GET /identity/v3/role_assignments?user.id=37c91fefe89a45b48df82a311e771ea3&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=62fba91cbca741d1a684f0a9987d388b => generated 610 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:54.501336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11581201-147c-443a-a796-e42904053557 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:54.501843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11581201-147c-443a-a796-e42904053557 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:54.501843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11581201-147c-443a-a796-e42904053557 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:54.504566 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 550/1090] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:54.510059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966411d9-8e90-4532-b34f-9b51c5de0415 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:54.510504 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966411d9-8e90-4532-b34f-9b51c5de0415 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:54.510604 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966411d9-8e90-4532-b34f-9b51c5de0415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:54.528476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-966411d9-8e90-4532-b34f-9b51c5de0415 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:54.529890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-966411d9-8e90-4532-b34f-9b51c5de0415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:54.537994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 541/1091] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:54 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:54.562248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11581201-147c-443a-a796-e42904053557 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:54.574832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11581201-147c-443a-a796-e42904053557 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:54.579268 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d758b-486a-4ba5-a27b-1b0a65958707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:54.580040 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d758b-486a-4ba5-a27b-1b0a65958707 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:54.580316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d758b-486a-4ba5-a27b-1b0a65958707 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:54.580584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d758b-486a-4ba5-a27b-1b0a65958707 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:54.591890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d758b-486a-4ba5-a27b-1b0a65958707 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:54.599479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-f50d758b-486a-4ba5-a27b-1b0a65958707 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:38:54.600948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 551/1092] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:54.607080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966411d9-8e90-4532-b34f-9b51c5de0415 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:54.616453 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966411d9-8e90-4532-b34f-9b51c5de0415 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:54.621128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898e80b-87cd-4f34-974e-466ee5c74ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:54.621785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e80b-87cd-4f34-974e-466ee5c74ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:54.622051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e80b-87cd-4f34-974e-466ee5c74ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:54.622319 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e80b-87cd-4f34-974e-466ee5c74ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:54.623106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898e80b-87cd-4f34-974e-466ee5c74ee1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:54.623479 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898e80b-87cd-4f34-974e-466ee5c74ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:54.625052 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898e80b-87cd-4f34-974e-466ee5c74ee1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:54.633455 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 542/1093] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:54 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:54.639581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d758b-486a-4ba5-a27b-1b0a65958707 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:54.650879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d758b-486a-4ba5-a27b-1b0a65958707 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:54.655473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb9aca-0a55-48f4-a9c0-d1c3ccb3abb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:54.656323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb9aca-0a55-48f4-a9c0-d1c3ccb3abb1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:54.656595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb9aca-0a55-48f4-a9c0-d1c3ccb3abb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:54.656863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb9aca-0a55-48f4-a9c0-d1c3ccb3abb1 admin admin] PATH_INFO: `/v3/users/b9ed5dfe5c564f15b140a7b4ceb4312a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:54.658146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb9aca-0a55-48f4-a9c0-d1c3ccb3abb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9ed5dfe5c564f15b140a7b4ceb4312a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:54.661083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb9aca-0a55-48f4-a9c0-d1c3ccb3abb1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:54.662693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 552/1094] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:38:54 2022] GET /identity/v3/users/b9ed5dfe5c564f15b140a7b4ceb4312a => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:54.668598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898e80b-87cd-4f34-974e-466ee5c74ee1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:54.678427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898e80b-87cd-4f34-974e-466ee5c74ee1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:54.683108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a744a1-651c-4aad-b4b8-a3afbf80e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:54.683945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a744a1-651c-4aad-b4b8-a3afbf80e2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:54.684224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a744a1-651c-4aad-b4b8-a3afbf80e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:54.684493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a744a1-651c-4aad-b4b8-a3afbf80e2a6 admin admin] PATH_INFO: `/v3/projects/acc85fd03001434da9b652de09fdaa7f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:54.685678 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a744a1-651c-4aad-b4b8-a3afbf80e2a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=acc85fd03001434da9b652de09fdaa7f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:54.687798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a744a1-651c-4aad-b4b8-a3afbf80e2a6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:54.689441 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 543/1095] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:38:54 2022] GET /identity/v3/projects/acc85fd03001434da9b652de09fdaa7f => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:54.695394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb9aca-0a55-48f4-a9c0-d1c3ccb3abb1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:54.705307 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb9aca-0a55-48f4-a9c0-d1c3ccb3abb1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:54.710774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee316e0-bf83-48d3-8156-07bf3de9d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:54.711643 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee316e0-bf83-48d3-8156-07bf3de9d82c admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:54.711925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee316e0-bf83-48d3-8156-07bf3de9d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:54.712201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee316e0-bf83-48d3-8156-07bf3de9d82c admin admin] PATH_INFO: `/v3/projects/acc85fd03001434da9b652de09fdaa7f/users/b9ed5dfe5c564f15b140a7b4ceb4312a/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:54.714168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee316e0-bf83-48d3-8156-07bf3de9d82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc85fd03001434da9b652de09fdaa7f, user_id=b9ed5dfe5c564f15b140a7b4ceb4312a, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:54.716817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee316e0-bf83-48d3-8156-07bf3de9d82c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:54.730345 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 553/1096] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:38:54 2022] PUT /identity/v3/projects/acc85fd03001434da9b652de09fdaa7f/users/b9ed5dfe5c564f15b140a7b4ceb4312a/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:38:56.895480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a43f1-85f8-4e1e-876d-ebc2309caefe None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:56.896017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a43f1-85f8-4e1e-876d-ebc2309caefe None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:56.896017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a43f1-85f8-4e1e-876d-ebc2309caefe None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:56.897775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 544/1097] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:56.903048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10ddd2-25cf-41c9-96fd-5f6de507961a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:56.903485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10ddd2-25cf-41c9-96fd-5f6de507961a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:56.903607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10ddd2-25cf-41c9-96fd-5f6de507961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:56.921575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-8f10ddd2-25cf-41c9-96fd-5f6de507961a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:56.922768 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8f10ddd2-25cf-41c9-96fd-5f6de507961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:56.980625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 554/1098] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:56 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:57.005118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a43f1-85f8-4e1e-876d-ebc2309caefe None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:57.016862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a43f1-85f8-4e1e-876d-ebc2309caefe None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:57.021909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144b0a4-bb09-4c20-a8a3-b3874176f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:57.022664 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144b0a4-bb09-4c20-a8a3-b3874176f4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:57.022967 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144b0a4-bb09-4c20-a8a3-b3874176f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:57.023239 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144b0a4-bb09-4c20-a8a3-b3874176f4d6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:57.032955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144b0a4-bb09-4c20-a8a3-b3874176f4d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:38:57.040377 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-3144b0a4-bb09-4c20-a8a3-b3874176f4d6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:38:57.041485 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 545/1099] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:38:57.047149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10ddd2-25cf-41c9-96fd-5f6de507961a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:57.056207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10ddd2-25cf-41c9-96fd-5f6de507961a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:57.061120 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bcea6-1961-4cba-8d00-0f9d1fa3f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:57.061771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bcea6-1961-4cba-8d00-0f9d1fa3f71c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:57.062048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bcea6-1961-4cba-8d00-0f9d1fa3f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:57.062318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bcea6-1961-4cba-8d00-0f9d1fa3f71c admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:57.063104 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bcea6-1961-4cba-8d00-0f9d1fa3f71c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:57.063419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bcea6-1961-4cba-8d00-0f9d1fa3f71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:57.064971 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bcea6-1961-4cba-8d00-0f9d1fa3f71c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:57.073568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 555/1100] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:38:57 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:57.079133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144b0a4-bb09-4c20-a8a3-b3874176f4d6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:57.089896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144b0a4-bb09-4c20-a8a3-b3874176f4d6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:57.094355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfdd3e-cd9a-4f1a-a7aa-67893e08316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:57.095215 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfdd3e-cd9a-4f1a-a7aa-67893e08316c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:57.095493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfdd3e-cd9a-4f1a-a7aa-67893e08316c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:57.095764 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfdd3e-cd9a-4f1a-a7aa-67893e08316c admin admin] PATH_INFO: `/v3/users/b9ed5dfe5c564f15b140a7b4ceb4312a` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:57.097478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfdd3e-cd9a-4f1a-a7aa-67893e08316c admin admin] RBAC: Authorizing `identity:get_user(user_id=b9ed5dfe5c564f15b140a7b4ceb4312a)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:57.099606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfdd3e-cd9a-4f1a-a7aa-67893e08316c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:57.101399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 546/1101] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:38:57 2022] GET /identity/v3/users/b9ed5dfe5c564f15b140a7b4ceb4312a => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:38:57.106593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bcea6-1961-4cba-8d00-0f9d1fa3f71c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:57.116548 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bcea6-1961-4cba-8d00-0f9d1fa3f71c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:57.120964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2f29c-3d19-4f0d-8c4e-33a010fe666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:57.121572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2f29c-3d19-4f0d-8c4e-33a010fe666c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:57.121847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2f29c-3d19-4f0d-8c4e-33a010fe666c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:57.122116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2f29c-3d19-4f0d-8c4e-33a010fe666c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:57.129603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2f29c-3d19-4f0d-8c4e-33a010fe666c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:57.131336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2f29c-3d19-4f0d-8c4e-33a010fe666c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:57.140113 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 556/1102] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:38:57 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:38:57.145713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfdd3e-cd9a-4f1a-a7aa-67893e08316c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:57.155309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfdd3e-cd9a-4f1a-a7aa-67893e08316c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:57.160729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210c8b6-a4f9-4ca2-ab21-b406e31e147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:57.161821 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c8b6-a4f9-4ca2-ab21-b406e31e147e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:57.162102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c8b6-a4f9-4ca2-ab21-b406e31e147e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:57.162378 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c8b6-a4f9-4ca2-ab21-b406e31e147e admin admin] PATH_INFO: `/v3/projects/acc85fd03001434da9b652de09fdaa7f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:57.163623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210c8b6-a4f9-4ca2-ab21-b406e31e147e admin admin] RBAC: Authorizing `identity:get_project(project_id=acc85fd03001434da9b652de09fdaa7f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:57.165658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210c8b6-a4f9-4ca2-ab21-b406e31e147e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:57.167331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 547/1103] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:38:57 2022] GET /identity/v3/projects/acc85fd03001434da9b652de09fdaa7f => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:57.173053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2f29c-3d19-4f0d-8c4e-33a010fe666c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:57.182374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2f29c-3d19-4f0d-8c4e-33a010fe666c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:57.186936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10d65-37a5-4824-95a6-e058c3a234fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:57.187591 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10d65-37a5-4824-95a6-e058c3a234fd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:57.187872 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10d65-37a5-4824-95a6-e058c3a234fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:57.188175 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10d65-37a5-4824-95a6-e058c3a234fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:57.189007 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10d65-37a5-4824-95a6-e058c3a234fd admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=acc85fd03001434da9b652de09fdaa7f, user.id=b9ed5dfe5c564f15b140a7b4ceb4312a) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:38:57.189342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10d65-37a5-4824-95a6-e058c3a234fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:57.191203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10d65-37a5-4824-95a6-e058c3a234fd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:57.196850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 557/1104] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:38:57 2022] GET /identity/v3/role_assignments?user.id=b9ed5dfe5c564f15b140a7b4ceb4312a&scope.project.id=acc85fd03001434da9b652de09fdaa7f&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 610 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:59.419125 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d1674-d619-48d4-b7d7-12a4b480fcf4 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:59.419634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d1674-d619-48d4-b7d7-12a4b480fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:59.419634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d1674-d619-48d4-b7d7-12a4b480fcf4 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:59.421518 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 548/1105] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:38:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:38:59.427085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a044d1d-59a7-49a3-8da8-3d660c414b95 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:59.427487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a044d1d-59a7-49a3-8da8-3d660c414b95 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:59.427639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a044d1d-59a7-49a3-8da8-3d660c414b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:59.445631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-3a044d1d-59a7-49a3-8da8-3d660c414b95 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:38:59.446836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3a044d1d-59a7-49a3-8da8-3d660c414b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:38:59.454402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 558/1106] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:38:59 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:38:59.480012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d1674-d619-48d4-b7d7-12a4b480fcf4 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:59.491936 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d1674-d619-48d4-b7d7-12a4b480fcf4 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:59.496321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c1b74-8826-42a2-a490-ff322080623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:59.497076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c1b74-8826-42a2-a490-ff322080623a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:59.497358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c1b74-8826-42a2-a490-ff322080623a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:59.497630 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c1b74-8826-42a2-a490-ff322080623a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:59.498834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c1b74-8826-42a2-a490-ff322080623a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:59.500501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c1b74-8826-42a2-a490-ff322080623a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:59.502031 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 549/1107] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:38:59 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:38:59.507793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a044d1d-59a7-49a3-8da8-3d660c414b95 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:38:59.516447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a044d1d-59a7-49a3-8da8-3d660c414b95 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:38:59.521607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e98f5-37d7-4e0e-8996-af538b12c2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:38:59.522246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e98f5-37d7-4e0e-8996-af538b12c2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:38:59.522531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e98f5-37d7-4e0e-8996-af538b12c2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:38:59.522856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e98f5-37d7-4e0e-8996-af538b12c2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:38:59.523586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e98f5-37d7-4e0e-8996-af538b12c2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:38:59.525480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e98f5-37d7-4e0e-8996-af538b12c2a1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:38:59.545406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 559/1108] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:38:59 2022] POST /identity/v3/users => generated 287 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:39:01.776491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd44a4-f129-47db-8d23-38d679a9bdd6 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:01.777025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd44a4-f129-47db-8d23-38d679a9bdd6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:01.777025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd44a4-f129-47db-8d23-38d679a9bdd6 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:01.778827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 550/1109] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:01.784040 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a3316-6b80-4d8b-a365-83f1d6e08f22 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:01.784510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a3316-6b80-4d8b-a365-83f1d6e08f22 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:01.784604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a3316-6b80-4d8b-a365-83f1d6e08f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:01.801760 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-037a3316-6b80-4d8b-a365-83f1d6e08f22 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:01.802958 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-037a3316-6b80-4d8b-a365-83f1d6e08f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:01.810396 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 560/1110] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:01 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:39:01.835515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd44a4-f129-47db-8d23-38d679a9bdd6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:01.847490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd44a4-f129-47db-8d23-38d679a9bdd6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:01.852095 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd66929-d9ee-48be-afc4-48b25dfb05f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:01.852914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd66929-d9ee-48be-afc4-48b25dfb05f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:01.853193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd66929-d9ee-48be-afc4-48b25dfb05f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:01.853464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd66929-d9ee-48be-afc4-48b25dfb05f3 admin admin] PATH_INFO: `/v3/roles/2d582daf740f43a8bd4b4471a3c1a99a` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:01.855072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd66929-d9ee-48be-afc4-48b25dfb05f3 admin admin] RBAC: Authorizing `identity:get_role(role_id=2d582daf740f43a8bd4b4471a3c1a99a)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:01.856098 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-ffd66929-d9ee-48be-afc4-48b25dfb05f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:39:01.856098 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:39:01.856098 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:39:01.856960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd66929-d9ee-48be-afc4-48b25dfb05f3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:01.858323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 551/1111] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:01 2022] GET /identity/v3/roles/2d582daf740f43a8bd4b4471a3c1a99a => generated 224 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:01.863734 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a3316-6b80-4d8b-a365-83f1d6e08f22 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:01.872435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a3316-6b80-4d8b-a365-83f1d6e08f22 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:01.876816 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8294a5-ef36-4921-917a-cccdc8b260e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:01.878301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8294a5-ef36-4921-917a-cccdc8b260e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:01.878721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8294a5-ef36-4921-917a-cccdc8b260e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:01.879018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8294a5-ef36-4921-917a-cccdc8b260e5 admin admin] PATH_INFO: `/v3/users/01e3422373644caaa39d3815aa86836f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:01.891855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8294a5-ef36-4921-917a-cccdc8b260e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=01e3422373644caaa39d3815aa86836f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:01.894607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8294a5-ef36-4921-917a-cccdc8b260e5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:01.896208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 561/1112] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:01 2022] GET /identity/v3/users/01e3422373644caaa39d3815aa86836f => generated 287 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:01.901561 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd66929-d9ee-48be-afc4-48b25dfb05f3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:01.911731 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd66929-d9ee-48be-afc4-48b25dfb05f3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:01.916241 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425375e-2e36-4f64-903b-ed45073d043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:01.916855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425375e-2e36-4f64-903b-ed45073d043f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:01.917138 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425375e-2e36-4f64-903b-ed45073d043f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:01.917414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425375e-2e36-4f64-903b-ed45073d043f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:01.925492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425375e-2e36-4f64-903b-ed45073d043f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:01.927239 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425375e-2e36-4f64-903b-ed45073d043f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:01.936028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 552/1113] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:39:01 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:39:01.941615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8294a5-ef36-4921-917a-cccdc8b260e5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:01.950744 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8294a5-ef36-4921-917a-cccdc8b260e5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:01.955167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f801-8cd6-4315-a3f5-2514eea31ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:01.956723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f801-8cd6-4315-a3f5-2514eea31ebd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:01.957009 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f801-8cd6-4315-a3f5-2514eea31ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:01.957279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f801-8cd6-4315-a3f5-2514eea31ebd admin admin] PATH_INFO: `/v3/projects/acc85fd03001434da9b652de09fdaa7f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:01.958431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717f801-8cd6-4315-a3f5-2514eea31ebd admin admin] RBAC: Authorizing `identity:get_project(project_id=acc85fd03001434da9b652de09fdaa7f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:01.960433 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717f801-8cd6-4315-a3f5-2514eea31ebd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:01.962018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 562/1114] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:39:01 2022] GET /identity/v3/projects/acc85fd03001434da9b652de09fdaa7f => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:39:01.967378 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425375e-2e36-4f64-903b-ed45073d043f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:01.976681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425375e-2e36-4f64-903b-ed45073d043f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:01.981205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267e2cb-6efe-4de4-a885-207f9e9632e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:01.981817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e2cb-6efe-4de4-a885-207f9e9632e4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:01.982099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e2cb-6efe-4de4-a885-207f9e9632e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:01.982374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e2cb-6efe-4de4-a885-207f9e9632e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:01.983228 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267e2cb-6efe-4de4-a885-207f9e9632e4 admin admin] RBAC: Adding query filter params (role.id=2d582daf740f43a8bd4b4471a3c1a99a, scope.project.id=acc85fd03001434da9b652de09fdaa7f, user.id=01e3422373644caaa39d3815aa86836f) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:01.983539 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267e2cb-6efe-4de4-a885-207f9e9632e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:01.985318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267e2cb-6efe-4de4-a885-207f9e9632e4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:01.990562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 553/1115] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:39:01 2022] GET /identity/v3/role_assignments?user.id=01e3422373644caaa39d3815aa86836f&scope.project.id=acc85fd03001434da9b652de09fdaa7f&role.id=2d582daf740f43a8bd4b4471a3c1a99a => generated 260 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:39:04.185692 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e0d21-7779-4161-9edc-832cc2367f12 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:04.186148 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e0d21-7779-4161-9edc-832cc2367f12 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:04.186237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e0d21-7779-4161-9edc-832cc2367f12 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:04.188123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 563/1116] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:04.193372 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f42b2d-ee25-4e36-a781-12ddfb9f8bbc None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:04.193753 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f42b2d-ee25-4e36-a781-12ddfb9f8bbc None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:04.193932 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f42b2d-ee25-4e36-a781-12ddfb9f8bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:04.212000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-f8f42b2d-ee25-4e36-a781-12ddfb9f8bbc None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:04.213195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f8f42b2d-ee25-4e36-a781-12ddfb9f8bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:04.220767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 554/1117] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:04 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:39:04.244889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e0d21-7779-4161-9edc-832cc2367f12 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:04.256652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e0d21-7779-4161-9edc-832cc2367f12 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:04.260955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab9a90-db5a-4737-b562-88de5c21d3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:04.261774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab9a90-db5a-4737-b562-88de5c21d3eb admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:04.262048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab9a90-db5a-4737-b562-88de5c21d3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:04.262317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab9a90-db5a-4737-b562-88de5c21d3eb admin admin] PATH_INFO: `/v3/roles/2d582daf740f43a8bd4b4471a3c1a99a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:04.263786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab9a90-db5a-4737-b562-88de5c21d3eb admin admin] RBAC: Authorizing `identity:get_role(role_id=2d582daf740f43a8bd4b4471a3c1a99a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:04.264809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-3eab9a90-db5a-4737-b562-88de5c21d3eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:39:04.264809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:39:04.264809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:39:04.265666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab9a90-db5a-4737-b562-88de5c21d3eb admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:04.266981 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 564/1118] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:04 2022] GET /identity/v3/roles/2d582daf740f43a8bd4b4471a3c1a99a => generated 224 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:04.272823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f42b2d-ee25-4e36-a781-12ddfb9f8bbc None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:04.281593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f42b2d-ee25-4e36-a781-12ddfb9f8bbc None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:04.286831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd69d5-cf94-439e-a7c0-f7e1aeec29df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:04.287671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd69d5-cf94-439e-a7c0-f7e1aeec29df admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:04.287950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd69d5-cf94-439e-a7c0-f7e1aeec29df admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:04.288222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd69d5-cf94-439e-a7c0-f7e1aeec29df admin admin] PATH_INFO: `/v3/users/01e3422373644caaa39d3815aa86836f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:04.289428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd69d5-cf94-439e-a7c0-f7e1aeec29df admin admin] RBAC: Authorizing `identity:get_user(user_id=01e3422373644caaa39d3815aa86836f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:04.291575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd69d5-cf94-439e-a7c0-f7e1aeec29df admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:04.293118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 555/1119] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:04 2022] GET /identity/v3/users/01e3422373644caaa39d3815aa86836f => generated 287 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:04.298225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab9a90-db5a-4737-b562-88de5c21d3eb admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:04.307877 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab9a90-db5a-4737-b562-88de5c21d3eb admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:04.312340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7336f4b-2f26-4bb5-9f0c-fb47c1c9fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:04.313153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7336f4b-2f26-4bb5-9f0c-fb47c1c9fb67 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:04.313437 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7336f4b-2f26-4bb5-9f0c-fb47c1c9fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:04.313708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7336f4b-2f26-4bb5-9f0c-fb47c1c9fb67 admin admin] PATH_INFO: `/v3/projects/acc85fd03001434da9b652de09fdaa7f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:04.314913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7336f4b-2f26-4bb5-9f0c-fb47c1c9fb67 admin admin] RBAC: Authorizing `identity:get_project(project_id=acc85fd03001434da9b652de09fdaa7f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:04.317474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7336f4b-2f26-4bb5-9f0c-fb47c1c9fb67 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:04.319118 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 565/1120] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:39:04 2022] GET /identity/v3/projects/acc85fd03001434da9b652de09fdaa7f => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:04.324428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd69d5-cf94-439e-a7c0-f7e1aeec29df admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:04.334339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd69d5-cf94-439e-a7c0-f7e1aeec29df admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:04.338807 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cabf9f-0f15-4285-8416-f10e50c9d67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:04.339641 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cabf9f-0f15-4285-8416-f10e50c9d67a admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:04.339922 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cabf9f-0f15-4285-8416-f10e50c9d67a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:04.340196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cabf9f-0f15-4285-8416-f10e50c9d67a admin admin] PATH_INFO: `/v3/projects/acc85fd03001434da9b652de09fdaa7f/users/01e3422373644caaa39d3815aa86836f/roles/2d582daf740f43a8bd4b4471a3c1a99a` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:04.342382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cabf9f-0f15-4285-8416-f10e50c9d67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc85fd03001434da9b652de09fdaa7f, user_id=01e3422373644caaa39d3815aa86836f, role_id=2d582daf740f43a8bd4b4471a3c1a99a)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:04.344992 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cabf9f-0f15-4285-8416-f10e50c9d67a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:04.358291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 556/1121] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:39:04 2022] PUT /identity/v3/projects/acc85fd03001434da9b652de09fdaa7f/users/01e3422373644caaa39d3815aa86836f/roles/2d582daf740f43a8bd4b4471a3c1a99a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:39:06.544126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb6905-7aca-4baf-8a9f-43d5e006a699 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:06.544663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb6905-7aca-4baf-8a9f-43d5e006a699 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:06.544663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb6905-7aca-4baf-8a9f-43d5e006a699 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:06.546436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 566/1122] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:06.552707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d589-07a2-4c88-bfcc-f89912c08004 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:06.553107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d589-07a2-4c88-bfcc-f89912c08004 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:06.553255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d589-07a2-4c88-bfcc-f89912c08004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:06.571421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-f468d589-07a2-4c88-bfcc-f89912c08004 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:06.572590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f468d589-07a2-4c88-bfcc-f89912c08004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:06.629092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 557/1123] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:06 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:39:06.653053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb6905-7aca-4baf-8a9f-43d5e006a699 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:06.665137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb6905-7aca-4baf-8a9f-43d5e006a699 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:06.669487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0af04-1e7e-4aa5-9505-facee5ca61ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:06.670307 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0af04-1e7e-4aa5-9505-facee5ca61ca admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:06.670585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0af04-1e7e-4aa5-9505-facee5ca61ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:06.670902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0af04-1e7e-4aa5-9505-facee5ca61ca admin admin] PATH_INFO: `/v3/roles/2d582daf740f43a8bd4b4471a3c1a99a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:06.672380 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0af04-1e7e-4aa5-9505-facee5ca61ca admin admin] RBAC: Authorizing `identity:get_role(role_id=2d582daf740f43a8bd4b4471a3c1a99a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:06.673946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0af04-1e7e-4aa5-9505-facee5ca61ca admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:06.675833 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 567/1124] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:06 2022] GET /identity/v3/roles/2d582daf740f43a8bd4b4471a3c1a99a => generated 224 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:06.681030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468d589-07a2-4c88-bfcc-f89912c08004 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:06.689772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468d589-07a2-4c88-bfcc-f89912c08004 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:06.694767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7846d5d-6b47-4126-a1c6-c17dd8184d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:06.695619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7846d5d-6b47-4126-a1c6-c17dd8184d75 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:06.695897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7846d5d-6b47-4126-a1c6-c17dd8184d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:06.696168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7846d5d-6b47-4126-a1c6-c17dd8184d75 admin admin] PATH_INFO: `/v3/users/01e3422373644caaa39d3815aa86836f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:06.697366 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7846d5d-6b47-4126-a1c6-c17dd8184d75 admin admin] RBAC: Authorizing `identity:get_user(user_id=01e3422373644caaa39d3815aa86836f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:06.699514 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7846d5d-6b47-4126-a1c6-c17dd8184d75 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:06.701176 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 558/1125] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:06 2022] GET /identity/v3/users/01e3422373644caaa39d3815aa86836f => generated 287 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:06.707122 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0af04-1e7e-4aa5-9505-facee5ca61ca admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:06.716396 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0af04-1e7e-4aa5-9505-facee5ca61ca admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:06.720878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47c108-a459-48ce-a13e-669ff92bec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:06.722185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c108-a459-48ce-a13e-669ff92bec00 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:06.722467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c108-a459-48ce-a13e-669ff92bec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:06.722737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c108-a459-48ce-a13e-669ff92bec00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:06.730552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47c108-a459-48ce-a13e-669ff92bec00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:06.732269 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47c108-a459-48ce-a13e-669ff92bec00 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:06.740911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 568/1126] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:39:06 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:39:06.746305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7846d5d-6b47-4126-a1c6-c17dd8184d75 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:06.755942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7846d5d-6b47-4126-a1c6-c17dd8184d75 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:06.760415 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dbb2a-578a-4367-b8a1-ecd702585d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:06.761210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbb2a-578a-4367-b8a1-ecd702585d4a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:06.761488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbb2a-578a-4367-b8a1-ecd702585d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:06.761761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbb2a-578a-4367-b8a1-ecd702585d4a admin admin] PATH_INFO: `/v3/projects/acc85fd03001434da9b652de09fdaa7f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:06.762951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dbb2a-578a-4367-b8a1-ecd702585d4a admin admin] RBAC: Authorizing `identity:get_project(project_id=acc85fd03001434da9b652de09fdaa7f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:06.764943 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dbb2a-578a-4367-b8a1-ecd702585d4a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:06.766524 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 559/1127] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:39:06 2022] GET /identity/v3/projects/acc85fd03001434da9b652de09fdaa7f => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:06.772698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47c108-a459-48ce-a13e-669ff92bec00 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:06.781307 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47c108-a459-48ce-a13e-669ff92bec00 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:06.786434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d3297-4e87-4f00-bd66-bce20dbe1056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:06.787076 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d3297-4e87-4f00-bd66-bce20dbe1056 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:06.787359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d3297-4e87-4f00-bd66-bce20dbe1056 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:06.787636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d3297-4e87-4f00-bd66-bce20dbe1056 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:06.788460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d3297-4e87-4f00-bd66-bce20dbe1056 admin admin] RBAC: Adding query filter params (role.id=2d582daf740f43a8bd4b4471a3c1a99a, scope.project.id=acc85fd03001434da9b652de09fdaa7f, user.id=01e3422373644caaa39d3815aa86836f) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:06.788771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d3297-4e87-4f00-bd66-bce20dbe1056 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:06.790594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d3297-4e87-4f00-bd66-bce20dbe1056 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:06.796431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 569/1128] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:39:06 2022] GET /identity/v3/role_assignments?user.id=01e3422373644caaa39d3815aa86836f&scope.project.id=acc85fd03001434da9b652de09fdaa7f&role.id=2d582daf740f43a8bd4b4471a3c1a99a => generated 610 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:09.018946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189d65-5e8e-4285-b0ee-b4ed17ffa560 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:09.019480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189d65-5e8e-4285-b0ee-b4ed17ffa560 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:09.019480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189d65-5e8e-4285-b0ee-b4ed17ffa560 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:09.021272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 560/1129] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:09.026622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871d71b-525a-4cee-90c1-23e3dc4a10e6 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:09.027059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871d71b-525a-4cee-90c1-23e3dc4a10e6 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:09.027194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871d71b-525a-4cee-90c1-23e3dc4a10e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:09.044886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d871d71b-525a-4cee-90c1-23e3dc4a10e6 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:09.046050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d871d71b-525a-4cee-90c1-23e3dc4a10e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:09.054564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 570/1130] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:09 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:39:09.077819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e189d65-5e8e-4285-b0ee-b4ed17ffa560 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:09.093413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e189d65-5e8e-4285-b0ee-b4ed17ffa560 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:09.098837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c2c48-9e1f-4ff7-90fa-e7ceb0229adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:09.099601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c2c48-9e1f-4ff7-90fa-e7ceb0229adb admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:09.100142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c2c48-9e1f-4ff7-90fa-e7ceb0229adb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:09.100416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c2c48-9e1f-4ff7-90fa-e7ceb0229adb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:09.101593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c2c48-9e1f-4ff7-90fa-e7ceb0229adb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:09.103306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c2c48-9e1f-4ff7-90fa-e7ceb0229adb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:09.104845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 561/1131] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:39:09 2022] GET /identity/v3/domains/default => generated 200 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:09.110214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871d71b-525a-4cee-90c1-23e3dc4a10e6 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:09.119559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871d71b-525a-4cee-90c1-23e3dc4a10e6 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:09.123967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d8dcb-4de9-4511-b2e0-220b7c7b5311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:09.124592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8dcb-4de9-4511-b2e0-220b7c7b5311 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:09.124870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8dcb-4de9-4511-b2e0-220b7c7b5311 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:09.125138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8dcb-4de9-4511-b2e0-220b7c7b5311 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:09.125862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d8dcb-4de9-4511-b2e0-220b7c7b5311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:09.127946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d8dcb-4de9-4511-b2e0-220b7c7b5311 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:09.152916 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 571/1132] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:39:09 2022] POST /identity/v3/projects => generated 312 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:39:11.378873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7f56-a07a-458e-8f78-09aef03a2c7c None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:11.379415 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7f56-a07a-458e-8f78-09aef03a2c7c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:11.379415 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7f56-a07a-458e-8f78-09aef03a2c7c None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:11.381173 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 562/1133] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:11.386335 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abbb72-dcd3-40be-ad56-f0768705d241 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:11.386773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abbb72-dcd3-40be-ad56-f0768705d241 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:11.386908 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abbb72-dcd3-40be-ad56-f0768705d241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:11.404694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-77abbb72-dcd3-40be-ad56-f0768705d241 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:11.405929 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-77abbb72-dcd3-40be-ad56-f0768705d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:11.461772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 572/1134] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:11 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:39:11.487115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7f56-a07a-458e-8f78-09aef03a2c7c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:11.498803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7f56-a07a-458e-8f78-09aef03a2c7c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:11.503825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b246e-d61e-4e11-b693-0bca567d0a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:11.504580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b246e-d61e-4e11-b693-0bca567d0a35 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:11.504855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b246e-d61e-4e11-b693-0bca567d0a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:11.505124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b246e-d61e-4e11-b693-0bca567d0a35 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:11.506281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b246e-d61e-4e11-b693-0bca567d0a35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:11.507970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b246e-d61e-4e11-b693-0bca567d0a35 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:11.509481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 563/1135] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:39:11 2022] GET /identity/v3/domains/default => generated 200 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:11.514710 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abbb72-dcd3-40be-ad56-f0768705d241 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:11.524523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abbb72-dcd3-40be-ad56-f0768705d241 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:11.528951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac30e34-0b70-403a-b809-974198d4b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:11.529585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30e34-0b70-403a-b809-974198d4b143 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:11.529868 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30e34-0b70-403a-b809-974198d4b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:11.530138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30e34-0b70-403a-b809-974198d4b143 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:11.530886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac30e34-0b70-403a-b809-974198d4b143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:11.532760 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac30e34-0b70-403a-b809-974198d4b143 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:11.557328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 573/1136] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:39:11 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:39:13.787371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2d40-a6bf-4670-bf63-6223345d5e1e None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:13.787907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2d40-a6bf-4670-bf63-6223345d5e1e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:13.787907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2d40-a6bf-4670-bf63-6223345d5e1e None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:13.789693 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 564/1137] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:13.795157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb696-5703-4384-84d2-168c157166ef None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:13.795555 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb696-5703-4384-84d2-168c157166ef None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:13.795710 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb696-5703-4384-84d2-168c157166ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:13.814177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-acffb696-5703-4384-84d2-168c157166ef None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:13.815819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-acffb696-5703-4384-84d2-168c157166ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:13.823390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 574/1138] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:13 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:39:13.847997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c2d40-a6bf-4670-bf63-6223345d5e1e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:13.861068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c2d40-a6bf-4670-bf63-6223345d5e1e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:13.866035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d6572-991e-4384-a26d-04d6927fb4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:13.866835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6572-991e-4384-a26d-04d6927fb4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:13.867120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6572-991e-4384-a26d-04d6927fb4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:13.867395 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6572-991e-4384-a26d-04d6927fb4b3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:13.877872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d6572-991e-4384-a26d-04d6927fb4b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:39:13.884634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-3d4d6572-991e-4384-a26d-04d6927fb4b3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:39:13.885786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 565/1139] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:39:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:39:13.891705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffb696-5703-4384-84d2-168c157166ef None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:13.900613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffb696-5703-4384-84d2-168c157166ef None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:13.905137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5872a-3eac-4a42-a6eb-70fbe08c66e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:13.905781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5872a-3eac-4a42-a6eb-70fbe08c66e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:13.906066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5872a-3eac-4a42-a6eb-70fbe08c66e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:13.906341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5872a-3eac-4a42-a6eb-70fbe08c66e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:13.907138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5872a-3eac-4a42-a6eb-70fbe08c66e5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:13.907444 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5872a-3eac-4a42-a6eb-70fbe08c66e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:13.909645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5872a-3eac-4a42-a6eb-70fbe08c66e5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:13.917594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 575/1140] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:39:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:13.923166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d6572-991e-4384-a26d-04d6927fb4b3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:13.933854 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d6572-991e-4384-a26d-04d6927fb4b3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:13.938309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16cc87-4a65-4b05-b51d-0777363b475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:13.939177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16cc87-4a65-4b05-b51d-0777363b475f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:13.939487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16cc87-4a65-4b05-b51d-0777363b475f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:13.939765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16cc87-4a65-4b05-b51d-0777363b475f admin admin] PATH_INFO: `/v3/users/8dd61531d1134157b27c1405a82751ae` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:13.952461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16cc87-4a65-4b05-b51d-0777363b475f admin admin] RBAC: Authorizing `identity:get_user(user_id=8dd61531d1134157b27c1405a82751ae)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:13.954558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16cc87-4a65-4b05-b51d-0777363b475f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:13.956839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 566/1141] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:13 2022] GET /identity/v3/users/8dd61531d1134157b27c1405a82751ae => generated 287 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:13.962235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5872a-3eac-4a42-a6eb-70fbe08c66e5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:13.972289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5872a-3eac-4a42-a6eb-70fbe08c66e5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:13.977114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e5f4c-767d-48eb-9b29-69a4b209bb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:13.977731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e5f4c-767d-48eb-9b29-69a4b209bb18 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:13.978013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e5f4c-767d-48eb-9b29-69a4b209bb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:13.978290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e5f4c-767d-48eb-9b29-69a4b209bb18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:13.985832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e5f4c-767d-48eb-9b29-69a4b209bb18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:13.987747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e5f4c-767d-48eb-9b29-69a4b209bb18 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:13.996363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 576/1142] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:39:13 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:39:14.001603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16cc87-4a65-4b05-b51d-0777363b475f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:14.010936 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16cc87-4a65-4b05-b51d-0777363b475f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:14.015434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3d3cf-ac9f-4a28-ba26-3837a6a34b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:14.016249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3d3cf-ac9f-4a28-ba26-3837a6a34b1c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:14.016530 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3d3cf-ac9f-4a28-ba26-3837a6a34b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:14.016806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3d3cf-ac9f-4a28-ba26-3837a6a34b1c admin admin] PATH_INFO: `/v3/projects/9941b3dbb555436f91f696df6327acca` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:14.018477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3d3cf-ac9f-4a28-ba26-3837a6a34b1c admin admin] RBAC: Authorizing `identity:get_project(project_id=9941b3dbb555436f91f696df6327acca)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:14.020525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3d3cf-ac9f-4a28-ba26-3837a6a34b1c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:14.022103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 567/1143] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:39:14 2022] GET /identity/v3/projects/9941b3dbb555436f91f696df6327acca => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:14.027464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e5f4c-767d-48eb-9b29-69a4b209bb18 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:14.036512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e5f4c-767d-48eb-9b29-69a4b209bb18 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:14.041099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29759f4-272d-4972-9360-c2e9f3aeeacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:14.041653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29759f4-272d-4972-9360-c2e9f3aeeacd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:14.041937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29759f4-272d-4972-9360-c2e9f3aeeacd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:14.042215 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29759f4-272d-4972-9360-c2e9f3aeeacd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:14.043070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29759f4-272d-4972-9360-c2e9f3aeeacd admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=9941b3dbb555436f91f696df6327acca, user.id=8dd61531d1134157b27c1405a82751ae) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:14.043383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29759f4-272d-4972-9360-c2e9f3aeeacd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:14.045196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29759f4-272d-4972-9360-c2e9f3aeeacd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:14.051107 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 577/1144] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:39:14 2022] GET /identity/v3/role_assignments?user.id=8dd61531d1134157b27c1405a82751ae&scope.project.id=9941b3dbb555436f91f696df6327acca&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:16.225856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91123c-682c-4482-b934-336306217705 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:16.226339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91123c-682c-4482-b934-336306217705 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:16.226421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91123c-682c-4482-b934-336306217705 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:16.228230 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 568/1145] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:16.233451 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dd104-0bcf-401a-865e-825ad360b260 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:16.233871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dd104-0bcf-401a-865e-825ad360b260 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:16.234014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dd104-0bcf-401a-865e-825ad360b260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:16.252823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-9d4dd104-0bcf-401a-865e-825ad360b260 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:16.253991 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9d4dd104-0bcf-401a-865e-825ad360b260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:16.261573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 578/1146] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:16 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:39:16.285329 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91123c-682c-4482-b934-336306217705 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:16.297177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91123c-682c-4482-b934-336306217705 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:16.302202 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb483801-1e15-4981-bd03-79ff0415fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:16.302997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb483801-1e15-4981-bd03-79ff0415fb04 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:16.303281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb483801-1e15-4981-bd03-79ff0415fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:16.303556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb483801-1e15-4981-bd03-79ff0415fb04 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:16.313430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb483801-1e15-4981-bd03-79ff0415fb04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:39:16.321253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-cb483801-1e15-4981-bd03-79ff0415fb04 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:39:16.322377 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 569/1147] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:39:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:39:16.327833 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dd104-0bcf-401a-865e-825ad360b260 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:16.336803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dd104-0bcf-401a-865e-825ad360b260 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:16.341294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662fad1-0545-48dc-a0c9-8a397fa93b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:16.341934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662fad1-0545-48dc-a0c9-8a397fa93b37 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:16.342215 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662fad1-0545-48dc-a0c9-8a397fa93b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:16.342492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662fad1-0545-48dc-a0c9-8a397fa93b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:16.343286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662fad1-0545-48dc-a0c9-8a397fa93b37 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:16.343592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662fad1-0545-48dc-a0c9-8a397fa93b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:16.345242 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662fad1-0545-48dc-a0c9-8a397fa93b37 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:16.356903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 579/1148] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:39:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:16.363351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb483801-1e15-4981-bd03-79ff0415fb04 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:16.373512 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb483801-1e15-4981-bd03-79ff0415fb04 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:16.378828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32673d09-3a01-44b9-9df6-b3f614a21f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:16.379664 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32673d09-3a01-44b9-9df6-b3f614a21f01 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:16.379947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32673d09-3a01-44b9-9df6-b3f614a21f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:16.380224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32673d09-3a01-44b9-9df6-b3f614a21f01 admin admin] PATH_INFO: `/v3/users/8dd61531d1134157b27c1405a82751ae` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:16.381427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32673d09-3a01-44b9-9df6-b3f614a21f01 admin admin] RBAC: Authorizing `identity:get_user(user_id=8dd61531d1134157b27c1405a82751ae)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:16.383570 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32673d09-3a01-44b9-9df6-b3f614a21f01 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:16.385123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 570/1149] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:16 2022] GET /identity/v3/users/8dd61531d1134157b27c1405a82751ae => generated 287 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:39:16.390806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662fad1-0545-48dc-a0c9-8a397fa93b37 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:16.400348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662fad1-0545-48dc-a0c9-8a397fa93b37 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:16.404897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742654-3afb-48ac-8590-cce3b86ce43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:16.405660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742654-3afb-48ac-8590-cce3b86ce43b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:16.405939 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742654-3afb-48ac-8590-cce3b86ce43b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:16.406212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742654-3afb-48ac-8590-cce3b86ce43b admin admin] PATH_INFO: `/v3/projects/9941b3dbb555436f91f696df6327acca` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:16.407400 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca742654-3afb-48ac-8590-cce3b86ce43b admin admin] RBAC: Authorizing `identity:get_project(project_id=9941b3dbb555436f91f696df6327acca)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:16.409409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca742654-3afb-48ac-8590-cce3b86ce43b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:16.411174 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 580/1150] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:39:16 2022] GET /identity/v3/projects/9941b3dbb555436f91f696df6327acca => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:16.416431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32673d09-3a01-44b9-9df6-b3f614a21f01 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:16.426274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32673d09-3a01-44b9-9df6-b3f614a21f01 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:16.430769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ced83-4ea8-4766-ae5d-9a6671a5b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:16.431611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ced83-4ea8-4766-ae5d-9a6671a5b2e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:16.431891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ced83-4ea8-4766-ae5d-9a6671a5b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:16.432169 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ced83-4ea8-4766-ae5d-9a6671a5b2e2 admin admin] PATH_INFO: `/v3/projects/9941b3dbb555436f91f696df6327acca/users/8dd61531d1134157b27c1405a82751ae/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:16.434114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ced83-4ea8-4766-ae5d-9a6671a5b2e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9941b3dbb555436f91f696df6327acca, user_id=8dd61531d1134157b27c1405a82751ae, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:16.436695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ced83-4ea8-4766-ae5d-9a6671a5b2e2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:16.450974 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 571/1151] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:39:16 2022] PUT /identity/v3/projects/9941b3dbb555436f91f696df6327acca/users/8dd61531d1134157b27c1405a82751ae/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:39:18.658437 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0c744-6a57-4a57-a0fd-e8980375ae56 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:18.659129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0c744-6a57-4a57-a0fd-e8980375ae56 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:18.659129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0c744-6a57-4a57-a0fd-e8980375ae56 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:18.660773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 581/1152] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:18.666026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737b26-632e-4815-8f04-f902eca8257c None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:18.666426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737b26-632e-4815-8f04-f902eca8257c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:18.666579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737b26-632e-4815-8f04-f902eca8257c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:18.683868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-3b737b26-632e-4815-8f04-f902eca8257c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:18.685049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3b737b26-632e-4815-8f04-f902eca8257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:18.747096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 572/1153] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:18 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:39:18.771744 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0c744-6a57-4a57-a0fd-e8980375ae56 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:18.784480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0c744-6a57-4a57-a0fd-e8980375ae56 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:18.788844 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a573b-ff75-42a0-a192-dc32c870f983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:18.789605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a573b-ff75-42a0-a192-dc32c870f983 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:18.789889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a573b-ff75-42a0-a192-dc32c870f983 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:18.790165 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a573b-ff75-42a0-a192-dc32c870f983 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:18.800210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a573b-ff75-42a0-a192-dc32c870f983 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:39:18.807024 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-232a573b-ff75-42a0-a192-dc32c870f983 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:39:18.808150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 582/1154] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:39:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:39:18.813660 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b737b26-632e-4815-8f04-f902eca8257c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:18.823389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b737b26-632e-4815-8f04-f902eca8257c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:18.827843 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e012800-3bde-4ef3-a390-2a2e4ffb2c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:18.828491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e012800-3bde-4ef3-a390-2a2e4ffb2c57 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:18.828774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e012800-3bde-4ef3-a390-2a2e4ffb2c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:18.829051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e012800-3bde-4ef3-a390-2a2e4ffb2c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:18.830430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e012800-3bde-4ef3-a390-2a2e4ffb2c57 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:18.830916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e012800-3bde-4ef3-a390-2a2e4ffb2c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:18.832506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e012800-3bde-4ef3-a390-2a2e4ffb2c57 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:18.840440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 573/1155] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:39:18 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:18.845960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a573b-ff75-42a0-a192-dc32c870f983 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:18.856036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a573b-ff75-42a0-a192-dc32c870f983 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:18.860519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8d94-dd77-42c1-8d17-bdda65f62181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:18.861362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8d94-dd77-42c1-8d17-bdda65f62181 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:18.861640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8d94-dd77-42c1-8d17-bdda65f62181 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:18.861918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8d94-dd77-42c1-8d17-bdda65f62181 admin admin] PATH_INFO: `/v3/users/8dd61531d1134157b27c1405a82751ae` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:18.863148 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab8d94-dd77-42c1-8d17-bdda65f62181 admin admin] RBAC: Authorizing `identity:get_user(user_id=8dd61531d1134157b27c1405a82751ae)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:18.865253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab8d94-dd77-42c1-8d17-bdda65f62181 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:18.866817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 583/1156] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:18 2022] GET /identity/v3/users/8dd61531d1134157b27c1405a82751ae => generated 287 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:39:18.871880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e012800-3bde-4ef3-a390-2a2e4ffb2c57 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:18.881773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e012800-3bde-4ef3-a390-2a2e4ffb2c57 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:18.892619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca95a34-1b80-4fff-ba7f-9361f67ff27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:18.892619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca95a34-1b80-4fff-ba7f-9361f67ff27a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:18.892619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca95a34-1b80-4fff-ba7f-9361f67ff27a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:18.892619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca95a34-1b80-4fff-ba7f-9361f67ff27a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:18.898650 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca95a34-1b80-4fff-ba7f-9361f67ff27a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:18.900387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca95a34-1b80-4fff-ba7f-9361f67ff27a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:18.909088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 574/1157] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:39:18 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:39:18.914527 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8d94-dd77-42c1-8d17-bdda65f62181 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:18.923854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8d94-dd77-42c1-8d17-bdda65f62181 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:18.928348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0214675-ef41-4c2c-b0b2-0c11a9c95101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:18.929157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214675-ef41-4c2c-b0b2-0c11a9c95101 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:18.929435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214675-ef41-4c2c-b0b2-0c11a9c95101 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:18.929707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214675-ef41-4c2c-b0b2-0c11a9c95101 admin admin] PATH_INFO: `/v3/projects/9941b3dbb555436f91f696df6327acca` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:18.930888 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0214675-ef41-4c2c-b0b2-0c11a9c95101 admin admin] RBAC: Authorizing `identity:get_project(project_id=9941b3dbb555436f91f696df6327acca)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:18.932871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0214675-ef41-4c2c-b0b2-0c11a9c95101 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:18.934456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 584/1158] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:39:18 2022] GET /identity/v3/projects/9941b3dbb555436f91f696df6327acca => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:18.940720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca95a34-1b80-4fff-ba7f-9361f67ff27a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:18.949170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca95a34-1b80-4fff-ba7f-9361f67ff27a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:18.953671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ae9f2-191c-4c45-9629-2bef2d592707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:18.954284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ae9f2-191c-4c45-9629-2bef2d592707 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:18.954663 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ae9f2-191c-4c45-9629-2bef2d592707 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:18.955706 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ae9f2-191c-4c45-9629-2bef2d592707 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:18.956423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ae9f2-191c-4c45-9629-2bef2d592707 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=9941b3dbb555436f91f696df6327acca, user.id=8dd61531d1134157b27c1405a82751ae) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:18.956733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ae9f2-191c-4c45-9629-2bef2d592707 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:18.958530 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ae9f2-191c-4c45-9629-2bef2d592707 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:18.964248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 575/1159] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:39:18 2022] GET /identity/v3/role_assignments?user.id=8dd61531d1134157b27c1405a82751ae&scope.project.id=9941b3dbb555436f91f696df6327acca&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 610 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:21.217184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b932d-5569-4af2-8292-222639e716fe None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:21.217699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b932d-5569-4af2-8292-222639e716fe None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:21.217809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b932d-5569-4af2-8292-222639e716fe None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:21.219539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 585/1160] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:21.225681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b912ed-4ee4-4dd2-86e2-c2f1b0468c0c None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:21.226094 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b912ed-4ee4-4dd2-86e2-c2f1b0468c0c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:21.226242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b912ed-4ee4-4dd2-86e2-c2f1b0468c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:21.244171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-47b912ed-4ee4-4dd2-86e2-c2f1b0468c0c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:21.245351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-47b912ed-4ee4-4dd2-86e2-c2f1b0468c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:21.253053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 576/1161] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:21 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:39:21.275674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b932d-5569-4af2-8292-222639e716fe None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:21.288046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b932d-5569-4af2-8292-222639e716fe None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:21.292397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28a836-1d59-4a94-93a5-4393e3f8ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:21.293008 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28a836-1d59-4a94-93a5-4393e3f8ffe6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:21.293288 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28a836-1d59-4a94-93a5-4393e3f8ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:21.293560 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28a836-1d59-4a94-93a5-4393e3f8ffe6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:21.301801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28a836-1d59-4a94-93a5-4393e3f8ffe6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:21.303554 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28a836-1d59-4a94-93a5-4393e3f8ffe6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:21.312157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 586/1162] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:39:21 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:39:21.317749 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b912ed-4ee4-4dd2-86e2-c2f1b0468c0c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:21.326761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b912ed-4ee4-4dd2-86e2-c2f1b0468c0c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:21.331279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a762b1-a639-49b9-b9ce-9fe775b678e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:21.332050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a762b1-a639-49b9-b9ce-9fe775b678e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:21.332331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a762b1-a639-49b9-b9ce-9fe775b678e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:21.332604 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a762b1-a639-49b9-b9ce-9fe775b678e7 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:21.339371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a762b1-a639-49b9-b9ce-9fe775b678e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:21.341173 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a762b1-a639-49b9-b9ce-9fe775b678e7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:21.355739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-91a762b1-a639-49b9-b9ce-9fe775b678e7 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 24 16:39:21.356833 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 577/1163] 10.222.0.117 () {56 vars in 1143 bytes} [Mon Jan 24 16:39:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:39:21.363343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28a836-1d59-4a94-93a5-4393e3f8ffe6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:21.371894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28a836-1d59-4a94-93a5-4393e3f8ffe6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:21.377090 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedb03c-6fe7-4c7b-a063-73b124845362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:21.377712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb03c-6fe7-4c7b-a063-73b124845362 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:21.377993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb03c-6fe7-4c7b-a063-73b124845362 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:21.378267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb03c-6fe7-4c7b-a063-73b124845362 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:21.379013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb03c-6fe7-4c7b-a063-73b124845362 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:21.379316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb03c-6fe7-4c7b-a063-73b124845362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:21.380862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb03c-6fe7-4c7b-a063-73b124845362 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:21.387903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 587/1164] 10.222.0.117 () {56 vars in 1141 bytes} [Mon Jan 24 16:39:21 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:23.592763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa489b-4a2e-491a-aaa5-0629512abd0f None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:23.593352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa489b-4a2e-491a-aaa5-0629512abd0f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:23.593352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa489b-4a2e-491a-aaa5-0629512abd0f None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:23.595246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 578/1165] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:23.600876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc867f-9ff8-49c1-9858-6bd0161f7b44 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:23.601273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc867f-9ff8-49c1-9858-6bd0161f7b44 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:23.601435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc867f-9ff8-49c1-9858-6bd0161f7b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:23.618924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f6bc867f-9ff8-49c1-9858-6bd0161f7b44 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:23.620110 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f6bc867f-9ff8-49c1-9858-6bd0161f7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:23.628655 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 588/1166] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:23 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:39:23.652146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa489b-4a2e-491a-aaa5-0629512abd0f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:23.664058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa489b-4a2e-491a-aaa5-0629512abd0f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:23.668370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734c6f-c00a-488b-925e-df7687e976c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:23.669000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734c6f-c00a-488b-925e-df7687e976c5 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:23.669283 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734c6f-c00a-488b-925e-df7687e976c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:23.669559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734c6f-c00a-488b-925e-df7687e976c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:23.670315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b734c6f-c00a-488b-925e-df7687e976c5 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:23.671373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-5b734c6f-c00a-488b-925e-df7687e976c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:39:23.671373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:39:23.671373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:39:23.672244 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b734c6f-c00a-488b-925e-df7687e976c5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:23.687304 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 579/1167] 10.222.0.117 () {60 vars in 1164 bytes} [Mon Jan 24 16:39:23 2022] POST /identity/v3/domains => generated 268 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:39:25.905464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66078f-6415-4e09-a340-dce82b8b073a None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:25.906059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66078f-6415-4e09-a340-dce82b8b073a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:25.906059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66078f-6415-4e09-a340-dce82b8b073a None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:25.908426 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 589/1168] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:25.913636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431829c-08f4-443f-95a4-bf6790a21032 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:25.914023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431829c-08f4-443f-95a4-bf6790a21032 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:25.914193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431829c-08f4-443f-95a4-bf6790a21032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:26.051947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-c431829c-08f4-443f-95a4-bf6790a21032 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:26.053172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c431829c-08f4-443f-95a4-bf6790a21032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:26.108404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 580/1169] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:25 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:39:26.132135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66078f-6415-4e09-a340-dce82b8b073a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:26.145362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66078f-6415-4e09-a340-dce82b8b073a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:26.149701 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2fb1e-0f34-4633-953e-d93c0f028e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:26.150542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2fb1e-0f34-4633-953e-d93c0f028e8f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:26.150850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2fb1e-0f34-4633-953e-d93c0f028e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:26.151128 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2fb1e-0f34-4633-953e-d93c0f028e8f admin admin] PATH_INFO: `/v3/domains/307d93469b7447fc883c9ac7e71f66bb` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:26.162837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2fb1e-0f34-4633-953e-d93c0f028e8f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=307d93469b7447fc883c9ac7e71f66bb)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:26.164746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2fb1e-0f34-4633-953e-d93c0f028e8f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:26.166347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 590/1170] 10.222.0.117 () {56 vars in 1209 bytes} [Mon Jan 24 16:39:26 2022] GET /identity/v3/domains/307d93469b7447fc883c9ac7e71f66bb => generated 268 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:26.171967 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431829c-08f4-443f-95a4-bf6790a21032 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:26.180689 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431829c-08f4-443f-95a4-bf6790a21032 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:26.185105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea40204-9994-4637-b594-02cb01d9a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:26.185735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea40204-9994-4637-b594-02cb01d9a5fb admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:26.186016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea40204-9994-4637-b594-02cb01d9a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:26.186284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea40204-9994-4637-b594-02cb01d9a5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:26.187020 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea40204-9994-4637-b594-02cb01d9a5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:26.188946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea40204-9994-4637-b594-02cb01d9a5fb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:26.213446 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 581/1171] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:39:26 2022] POST /identity/v3/projects => generated 362 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:39:28.428252 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dba94-dd7a-4d88-8a72-4d1a28020f09 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:28.428767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dba94-dd7a-4d88-8a72-4d1a28020f09 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:28.428767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dba94-dd7a-4d88-8a72-4d1a28020f09 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:28.430483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 591/1172] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:28.435618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274fba0-50c6-4301-b47a-9068a8a28946 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:28.436040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274fba0-50c6-4301-b47a-9068a8a28946 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:28.436168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274fba0-50c6-4301-b47a-9068a8a28946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:28.453388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d274fba0-50c6-4301-b47a-9068a8a28946 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:28.455104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d274fba0-50c6-4301-b47a-9068a8a28946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:28.511174 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 582/1173] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:28 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:39:28.536451 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dba94-dd7a-4d88-8a72-4d1a28020f09 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:28.549272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dba94-dd7a-4d88-8a72-4d1a28020f09 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:28.553681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b198d0-61fd-4134-b2f6-188cf20aeab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:28.554509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b198d0-61fd-4134-b2f6-188cf20aeab7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:28.554814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b198d0-61fd-4134-b2f6-188cf20aeab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:28.555089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b198d0-61fd-4134-b2f6-188cf20aeab7 admin admin] PATH_INFO: `/v3/domains/307d93469b7447fc883c9ac7e71f66bb` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:28.556266 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b198d0-61fd-4134-b2f6-188cf20aeab7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=307d93469b7447fc883c9ac7e71f66bb)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:28.558184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b198d0-61fd-4134-b2f6-188cf20aeab7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:28.559755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 592/1174] 10.222.0.117 () {56 vars in 1209 bytes} [Mon Jan 24 16:39:28 2022] GET /identity/v3/domains/307d93469b7447fc883c9ac7e71f66bb => generated 268 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:28.565171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274fba0-50c6-4301-b47a-9068a8a28946 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:28.573871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274fba0-50c6-4301-b47a-9068a8a28946 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:28.578309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618cf36-2ec8-438c-a5fe-c407e81c15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:28.578990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618cf36-2ec8-438c-a5fe-c407e81c15f6 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:28.579272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618cf36-2ec8-438c-a5fe-c407e81c15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:28.579541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618cf36-2ec8-438c-a5fe-c407e81c15f6 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:28.580262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618cf36-2ec8-438c-a5fe-c407e81c15f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:28.582136 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618cf36-2ec8-438c-a5fe-c407e81c15f6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:28.602929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 583/1175] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:39:28 2022] POST /identity/v3/users => generated 312 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:39:30.838148 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ef78c-41b9-4056-a577-1595b94a0921 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:30.838705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ef78c-41b9-4056-a577-1595b94a0921 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:30.838705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ef78c-41b9-4056-a577-1595b94a0921 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:30.840518 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 593/1176] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:30.845855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3537c7-5c2b-409a-86b4-8516ba1523c9 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:30.846262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3537c7-5c2b-409a-86b4-8516ba1523c9 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:30.846439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3537c7-5c2b-409a-86b4-8516ba1523c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:30.864262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7f3537c7-5c2b-409a-86b4-8516ba1523c9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:30.865430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7f3537c7-5c2b-409a-86b4-8516ba1523c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:30.872924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 584/1177] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:30 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:39:30.897572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ef78c-41b9-4056-a577-1595b94a0921 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:30.909953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ef78c-41b9-4056-a577-1595b94a0921 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:30.914279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee5a4-9415-4d66-8f54-4e19f810d72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:30.915068 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee5a4-9415-4d66-8f54-4e19f810d72f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:30.915351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee5a4-9415-4d66-8f54-4e19f810d72f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:30.915625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee5a4-9415-4d66-8f54-4e19f810d72f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:30.926548 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee5a4-9415-4d66-8f54-4e19f810d72f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:39:30.933354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-7bdee5a4-9415-4d66-8f54-4e19f810d72f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:39:30.934485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 594/1178] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:39:30.940617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3537c7-5c2b-409a-86b4-8516ba1523c9 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:30.949240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3537c7-5c2b-409a-86b4-8516ba1523c9 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:30.953605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc328713-4249-4481-b55c-3f93c9ccff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:30.954897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc328713-4249-4481-b55c-3f93c9ccff4e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:30.955177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc328713-4249-4481-b55c-3f93c9ccff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:30.955447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc328713-4249-4481-b55c-3f93c9ccff4e admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:30.956198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc328713-4249-4481-b55c-3f93c9ccff4e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:30.956500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc328713-4249-4481-b55c-3f93c9ccff4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:30.958060 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc328713-4249-4481-b55c-3f93c9ccff4e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:30.965891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 585/1179] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:39:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:30.971315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee5a4-9415-4d66-8f54-4e19f810d72f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:30.980925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee5a4-9415-4d66-8f54-4e19f810d72f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:30.985586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a672d-4f77-4f36-893d-ef7eb0042349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:30.986403 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a672d-4f77-4f36-893d-ef7eb0042349 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:30.986689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a672d-4f77-4f36-893d-ef7eb0042349 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:30.986999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a672d-4f77-4f36-893d-ef7eb0042349 admin admin] PATH_INFO: `/v3/users/1f15cc92beb1418cbdff4792a09a187a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:31.001547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a672d-4f77-4f36-893d-ef7eb0042349 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f15cc92beb1418cbdff4792a09a187a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:31.003692 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a672d-4f77-4f36-893d-ef7eb0042349 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:31.005277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 595/1180] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:30 2022] GET /identity/v3/users/1f15cc92beb1418cbdff4792a09a187a => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:31.010677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc328713-4249-4481-b55c-3f93c9ccff4e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:31.020761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc328713-4249-4481-b55c-3f93c9ccff4e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:31.025180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fa452-536e-4c94-bb7f-2d09db9aafe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:31.025792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fa452-536e-4c94-bb7f-2d09db9aafe5 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:31.026074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fa452-536e-4c94-bb7f-2d09db9aafe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:31.026352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fa452-536e-4c94-bb7f-2d09db9aafe5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:31.033968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fa452-536e-4c94-bb7f-2d09db9aafe5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:31.035722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fa452-536e-4c94-bb7f-2d09db9aafe5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:31.044266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 586/1181] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:39:31 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:39:31.049538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a672d-4f77-4f36-893d-ef7eb0042349 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:31.058726 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a672d-4f77-4f36-893d-ef7eb0042349 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:31.063860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9449c-e28c-4d02-8689-3513f87f5c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:31.064667 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9449c-e28c-4d02-8689-3513f87f5c6b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:31.065588 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9449c-e28c-4d02-8689-3513f87f5c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:31.065588 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9449c-e28c-4d02-8689-3513f87f5c6b admin admin] PATH_INFO: `/v3/projects/807d39bc640e41c2b4c937f4eda8f840` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:31.066374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9449c-e28c-4d02-8689-3513f87f5c6b admin admin] RBAC: Authorizing `identity:get_project(project_id=807d39bc640e41c2b4c937f4eda8f840)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:31.068413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9449c-e28c-4d02-8689-3513f87f5c6b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:31.070011 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 596/1182] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:39:31 2022] GET /identity/v3/projects/807d39bc640e41c2b4c937f4eda8f840 => generated 362 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:31.075446 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fa452-536e-4c94-bb7f-2d09db9aafe5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:31.084452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fa452-536e-4c94-bb7f-2d09db9aafe5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:31.088992 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac5ad2-9550-4721-98eb-2838799254b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:31.089544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5ad2-9550-4721-98eb-2838799254b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:31.089825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5ad2-9550-4721-98eb-2838799254b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:31.090101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5ad2-9550-4721-98eb-2838799254b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:31.090963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac5ad2-9550-4721-98eb-2838799254b8 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=807d39bc640e41c2b4c937f4eda8f840, user.id=1f15cc92beb1418cbdff4792a09a187a) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:31.091274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac5ad2-9550-4721-98eb-2838799254b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:31.093046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac5ad2-9550-4721-98eb-2838799254b8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:31.098219 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 587/1183] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:39:31 2022] GET /identity/v3/role_assignments?user.id=1f15cc92beb1418cbdff4792a09a187a&scope.project.id=807d39bc640e41c2b4c937f4eda8f840&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 260 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:33.255434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369caae-114b-4c80-a06e-a927c543c3f4 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:33.255978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369caae-114b-4c80-a06e-a927c543c3f4 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:33.255978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369caae-114b-4c80-a06e-a927c543c3f4 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:33.257764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 597/1184] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:33.263073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab7f2-95e4-498c-ba3e-3c4d072afd2e None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:33.263515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab7f2-95e4-498c-ba3e-3c4d072afd2e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:33.263637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab7f2-95e4-498c-ba3e-3c4d072afd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:33.281301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a4bab7f2-95e4-498c-ba3e-3c4d072afd2e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:33.283002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a4bab7f2-95e4-498c-ba3e-3c4d072afd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:33.290475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 588/1185] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:33 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:39:33.314899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369caae-114b-4c80-a06e-a927c543c3f4 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:33.326665 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369caae-114b-4c80-a06e-a927c543c3f4 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:33.332195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bb1d6-46c2-4980-824b-cd809373726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:33.332948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bb1d6-46c2-4980-824b-cd809373726b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:33.333226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bb1d6-46c2-4980-824b-cd809373726b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:33.333498 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bb1d6-46c2-4980-824b-cd809373726b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:33.343430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bb1d6-46c2-4980-824b-cd809373726b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:39:33.350975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-100bb1d6-46c2-4980-824b-cd809373726b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:39:33.352110 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 598/1186] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:39:33.357699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bab7f2-95e4-498c-ba3e-3c4d072afd2e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:33.366294 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bab7f2-95e4-498c-ba3e-3c4d072afd2e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:33.370667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02116f-6dea-4664-a6de-39a824750d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:33.371332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02116f-6dea-4664-a6de-39a824750d1d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:33.371610 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02116f-6dea-4664-a6de-39a824750d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:33.371880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02116f-6dea-4664-a6de-39a824750d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:33.372626 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02116f-6dea-4664-a6de-39a824750d1d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:33.372928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02116f-6dea-4664-a6de-39a824750d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:33.374494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02116f-6dea-4664-a6de-39a824750d1d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:33.383383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 589/1187] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:39:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:33.388711 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bb1d6-46c2-4980-824b-cd809373726b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:33.399150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bb1d6-46c2-4980-824b-cd809373726b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:33.403591 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9f493-8485-41d0-bc7a-426f83b67129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:33.404413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9f493-8485-41d0-bc7a-426f83b67129 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:33.404737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9f493-8485-41d0-bc7a-426f83b67129 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:33.404963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9f493-8485-41d0-bc7a-426f83b67129 admin admin] PATH_INFO: `/v3/users/1f15cc92beb1418cbdff4792a09a187a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:33.406139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9f493-8485-41d0-bc7a-426f83b67129 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f15cc92beb1418cbdff4792a09a187a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:33.408635 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9f493-8485-41d0-bc7a-426f83b67129 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:33.410338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 599/1188] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:33 2022] GET /identity/v3/users/1f15cc92beb1418cbdff4792a09a187a => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:39:33.415310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02116f-6dea-4664-a6de-39a824750d1d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:33.425177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02116f-6dea-4664-a6de-39a824750d1d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:33.429631 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de6827-9d84-43e7-81ca-ae5e616619d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:33.430450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de6827-9d84-43e7-81ca-ae5e616619d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:33.430733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de6827-9d84-43e7-81ca-ae5e616619d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:33.431045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de6827-9d84-43e7-81ca-ae5e616619d4 admin admin] PATH_INFO: `/v3/projects/807d39bc640e41c2b4c937f4eda8f840` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:33.432223 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de6827-9d84-43e7-81ca-ae5e616619d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=807d39bc640e41c2b4c937f4eda8f840)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:33.434229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de6827-9d84-43e7-81ca-ae5e616619d4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:33.435908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 590/1189] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:39:33 2022] GET /identity/v3/projects/807d39bc640e41c2b4c937f4eda8f840 => generated 362 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:33.442106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9f493-8485-41d0-bc7a-426f83b67129 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:33.451768 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9f493-8485-41d0-bc7a-426f83b67129 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:33.456765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f311f9-29ee-473e-919b-c38fbd01fb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:33.457590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f311f9-29ee-473e-919b-c38fbd01fb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:33.457870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f311f9-29ee-473e-919b-c38fbd01fb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:33.458143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f311f9-29ee-473e-919b-c38fbd01fb3b admin admin] PATH_INFO: `/v3/projects/807d39bc640e41c2b4c937f4eda8f840/users/1f15cc92beb1418cbdff4792a09a187a/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:33.460101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f311f9-29ee-473e-919b-c38fbd01fb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=807d39bc640e41c2b4c937f4eda8f840, user_id=1f15cc92beb1418cbdff4792a09a187a, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:33.462677 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f311f9-29ee-473e-919b-c38fbd01fb3b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:33.475810 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 600/1190] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:39:33 2022] PUT /identity/v3/projects/807d39bc640e41c2b4c937f4eda8f840/users/1f15cc92beb1418cbdff4792a09a187a/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:39:35.697744 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde2ab1-6df3-46cc-abec-498c46e2caa9 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:35.698301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde2ab1-6df3-46cc-abec-498c46e2caa9 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:35.698301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde2ab1-6df3-46cc-abec-498c46e2caa9 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:35.700102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 591/1191] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:39:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:39:35.705960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e557f2-0604-4aea-bf6a-ed117959d366 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:35.706358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e557f2-0604-4aea-bf6a-ed117959d366 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:35.706514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e557f2-0604-4aea-bf6a-ed117959d366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:35.724681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-60e557f2-0604-4aea-bf6a-ed117959d366 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:39:35.725856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-60e557f2-0604-4aea-bf6a-ed117959d366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:39:35.780174 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 601/1192] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:39:35 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:39:35.804873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde2ab1-6df3-46cc-abec-498c46e2caa9 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:35.817077 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde2ab1-6df3-46cc-abec-498c46e2caa9 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:35.821351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e24ec1-b34f-4601-af35-b1c24ee4968c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:35.822107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24ec1-b34f-4601-af35-b1c24ee4968c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:35.822389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24ec1-b34f-4601-af35-b1c24ee4968c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:35.822663 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24ec1-b34f-4601-af35-b1c24ee4968c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:35.833033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e24ec1-b34f-4601-af35-b1c24ee4968c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:39:35.839794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-b7e24ec1-b34f-4601-af35-b1c24ee4968c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:39:35.840896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 592/1193] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:39:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:39:35.847148 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e557f2-0604-4aea-bf6a-ed117959d366 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:35.856075 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e557f2-0604-4aea-bf6a-ed117959d366 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:35.860652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff6453-bd95-4eca-ad9b-0fe9aada2e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:35.861290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff6453-bd95-4eca-ad9b-0fe9aada2e30 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:35.861570 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff6453-bd95-4eca-ad9b-0fe9aada2e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:35.861840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff6453-bd95-4eca-ad9b-0fe9aada2e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:35.862587 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff6453-bd95-4eca-ad9b-0fe9aada2e30 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:35.862924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff6453-bd95-4eca-ad9b-0fe9aada2e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:35.864488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff6453-bd95-4eca-ad9b-0fe9aada2e30 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:35.872464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 602/1194] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:39:35 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:35.877928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e24ec1-b34f-4601-af35-b1c24ee4968c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:35.887803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e24ec1-b34f-4601-af35-b1c24ee4968c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:35.892980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36be98-ec88-4da4-b8e2-5ab570ab0ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:35.893804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36be98-ec88-4da4-b8e2-5ab570ab0ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:35.894086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36be98-ec88-4da4-b8e2-5ab570ab0ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:35.894359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36be98-ec88-4da4-b8e2-5ab570ab0ff6 admin admin] PATH_INFO: `/v3/users/1f15cc92beb1418cbdff4792a09a187a` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:35.895607 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36be98-ec88-4da4-b8e2-5ab570ab0ff6 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f15cc92beb1418cbdff4792a09a187a)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:35.897694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36be98-ec88-4da4-b8e2-5ab570ab0ff6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:35.899281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 593/1195] 10.222.0.117 () {56 vars in 1203 bytes} [Mon Jan 24 16:39:35 2022] GET /identity/v3/users/1f15cc92beb1418cbdff4792a09a187a => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:35.904340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff6453-bd95-4eca-ad9b-0fe9aada2e30 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:35.914149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff6453-bd95-4eca-ad9b-0fe9aada2e30 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:35.918531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c3771-d092-469a-a0e0-3f12ae6a0fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:35.919177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c3771-d092-469a-a0e0-3f12ae6a0fca admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:35.919458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c3771-d092-469a-a0e0-3f12ae6a0fca admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:35.919732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c3771-d092-469a-a0e0-3f12ae6a0fca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:35.927733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c3771-d092-469a-a0e0-3f12ae6a0fca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:35.929433 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c3771-d092-469a-a0e0-3f12ae6a0fca admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:35.938659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 603/1196] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:39:35 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:39:35.943924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36be98-ec88-4da4-b8e2-5ab570ab0ff6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:35.953175 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36be98-ec88-4da4-b8e2-5ab570ab0ff6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:35.957887 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d887a35-3aaf-40b5-9dff-bc5641bf0a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:35.958684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887a35-3aaf-40b5-9dff-bc5641bf0a1b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:35.959003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887a35-3aaf-40b5-9dff-bc5641bf0a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:35.959280 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887a35-3aaf-40b5-9dff-bc5641bf0a1b admin admin] PATH_INFO: `/v3/projects/807d39bc640e41c2b4c937f4eda8f840` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:35.960450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d887a35-3aaf-40b5-9dff-bc5641bf0a1b admin admin] RBAC: Authorizing `identity:get_project(project_id=807d39bc640e41c2b4c937f4eda8f840)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:35.962433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d887a35-3aaf-40b5-9dff-bc5641bf0a1b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:35.964202 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 594/1197] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:39:35 2022] GET /identity/v3/projects/807d39bc640e41c2b4c937f4eda8f840 => generated 362 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:39:35.969634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c3771-d092-469a-a0e0-3f12ae6a0fca admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:39:35.978271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c3771-d092-469a-a0e0-3f12ae6a0fca admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:39:35.982763 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189304f-2ba9-4a7b-9f1d-6b1761498a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:39:35.983379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189304f-2ba9-4a7b-9f1d-6b1761498a8d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:39:35.983662 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189304f-2ba9-4a7b-9f1d-6b1761498a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:39:35.983940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189304f-2ba9-4a7b-9f1d-6b1761498a8d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:39:35.985263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189304f-2ba9-4a7b-9f1d-6b1761498a8d admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=807d39bc640e41c2b4c937f4eda8f840, user.id=1f15cc92beb1418cbdff4792a09a187a) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:39:35.985569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189304f-2ba9-4a7b-9f1d-6b1761498a8d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:39:35.987385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189304f-2ba9-4a7b-9f1d-6b1761498a8d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:39:35.992919 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 604/1198] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:39:35 2022] GET /identity/v3/role_assignments?user.id=1f15cc92beb1418cbdff4792a09a187a&scope.project.id=807d39bc640e41c2b4c937f4eda8f840&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 610 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:36.746505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68577bbe-1791-40cf-aa6c-ec0a0bab3c5c None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:36.746505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68577bbe-1791-40cf-aa6c-ec0a0bab3c5c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:36.746505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68577bbe-1791-40cf-aa6c-ec0a0bab3c5c None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:36.746505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 595/1199] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:40:36 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:40:36.752693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72061e3-9dd4-4113-ae5e-781ea7816583 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:36.753225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72061e3-9dd4-4113-ae5e-781ea7816583 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:36.753372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72061e3-9dd4-4113-ae5e-781ea7816583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:36.777749 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-c72061e3-9dd4-4113-ae5e-781ea7816583 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:40:36.779240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c72061e3-9dd4-4113-ae5e-781ea7816583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:40:36.795477 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 605/1200] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:40:36 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:40:36.824290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68577bbe-1791-40cf-aa6c-ec0a0bab3c5c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:36.837803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68577bbe-1791-40cf-aa6c-ec0a0bab3c5c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:36.843133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b8d6c-be71-4a28-be63-58ad62231e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:36.844012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b8d6c-be71-4a28-be63-58ad62231e1a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:36.844298 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b8d6c-be71-4a28-be63-58ad62231e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:36.844572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b8d6c-be71-4a28-be63-58ad62231e1a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:36.857644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b8d6c-be71-4a28-be63-58ad62231e1a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:36.860111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b8d6c-be71-4a28-be63-58ad62231e1a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:36.887272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-8c8b8d6c-be71-4a28-be63-58ad62231e1a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:36.889148 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 596/1201] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:36.896831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72061e3-9dd4-4113-ae5e-781ea7816583 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:36.909994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72061e3-9dd4-4113-ae5e-781ea7816583 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:36.915986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f0714-dd47-4134-a8f7-7c1e72edb80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:36.916661 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0714-dd47-4134-a8f7-7c1e72edb80a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:36.916946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0714-dd47-4134-a8f7-7c1e72edb80a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:36.917522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0714-dd47-4134-a8f7-7c1e72edb80a admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:36.917998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f0714-dd47-4134-a8f7-7c1e72edb80a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:36.918433 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f0714-dd47-4134-a8f7-7c1e72edb80a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:36.920244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f0714-dd47-4134-a8f7-7c1e72edb80a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:36.934533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 606/1202] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:36.941980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b8d6c-be71-4a28-be63-58ad62231e1a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:36.954951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b8d6c-be71-4a28-be63-58ad62231e1a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:36.960146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fb5d0-a15a-4508-9fe0-07bb0a6f78d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:36.961015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fb5d0-a15a-4508-9fe0-07bb0a6f78d6 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:36.961352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fb5d0-a15a-4508-9fe0-07bb0a6f78d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:36.961703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fb5d0-a15a-4508-9fe0-07bb0a6f78d6 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:36.962714 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fb5d0-a15a-4508-9fe0-07bb0a6f78d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:36.965996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fb5d0-a15a-4508-9fe0-07bb0a6f78d6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:37.003053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 597/1203] 10.222.0.117 () {60 vars in 1158 bytes} [Mon Jan 24 16:40:36 2022] POST /identity/v3/users => generated 252 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:40:39.698020 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e4cf-d092-4a8d-9f05-656b952ce583 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:39.699255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e4cf-d092-4a8d-9f05-656b952ce583 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:39.699255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e4cf-d092-4a8d-9f05-656b952ce583 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:39.701557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 607/1204] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:40:39 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:40:39.708009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf03b-c094-4a4e-876e-b66101a98767 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:39.708502 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf03b-c094-4a4e-876e-b66101a98767 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:39.708600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf03b-c094-4a4e-876e-b66101a98767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:39.733530 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ebecf03b-c094-4a4e-876e-b66101a98767 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:40:39.734951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ebecf03b-c094-4a4e-876e-b66101a98767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:40:39.744823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 598/1205] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:40:39 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:40:39.772785 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427e4cf-d092-4a8d-9f05-656b952ce583 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:39.789290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427e4cf-d092-4a8d-9f05-656b952ce583 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:39.801042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eda364-be44-48a3-9662-e7802eac098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:39.801864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eda364-be44-48a3-9662-e7802eac098a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:39.802145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eda364-be44-48a3-9662-e7802eac098a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:39.802419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eda364-be44-48a3-9662-e7802eac098a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:39.817822 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eda364-be44-48a3-9662-e7802eac098a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:40:39.825460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-b6eda364-be44-48a3-9662-e7802eac098a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:40:39.830794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 608/1206] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:39.833110 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf03b-c094-4a4e-876e-b66101a98767 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:39.843654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf03b-c094-4a4e-876e-b66101a98767 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:39.848781 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bade95-5538-4a3b-b002-f0bbb17a0535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:39.849515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bade95-5538-4a3b-b002-f0bbb17a0535 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:39.849784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bade95-5538-4a3b-b002-f0bbb17a0535 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:39.850096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bade95-5538-4a3b-b002-f0bbb17a0535 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:39.851016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bade95-5538-4a3b-b002-f0bbb17a0535 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:39.851359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bade95-5538-4a3b-b002-f0bbb17a0535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:39.853217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bade95-5538-4a3b-b002-f0bbb17a0535 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:39.862343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 599/1207] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:40:39 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:39.868846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eda364-be44-48a3-9662-e7802eac098a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:39.880612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eda364-be44-48a3-9662-e7802eac098a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:39.885203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab892c-8f3d-4d94-b661-37a235e5a4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:39.886625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab892c-8f3d-4d94-b661-37a235e5a4db admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:39.886944 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab892c-8f3d-4d94-b661-37a235e5a4db admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:39.887248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab892c-8f3d-4d94-b661-37a235e5a4db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:39.899395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab892c-8f3d-4d94-b661-37a235e5a4db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:39.901272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab892c-8f3d-4d94-b661-37a235e5a4db admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:39.918717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-71ab892c-8f3d-4d94-b661-37a235e5a4db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:39.920112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 609/1208] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:39.926395 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bade95-5538-4a3b-b002-f0bbb17a0535 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:39.939895 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bade95-5538-4a3b-b002-f0bbb17a0535 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:39.945180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409a677-f354-4fb0-9fbe-5c0419e70efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:39.945923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409a677-f354-4fb0-9fbe-5c0419e70efb admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:39.946285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409a677-f354-4fb0-9fbe-5c0419e70efb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:39.946595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409a677-f354-4fb0-9fbe-5c0419e70efb admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:39.947523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409a677-f354-4fb0-9fbe-5c0419e70efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:39.949073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409a677-f354-4fb0-9fbe-5c0419e70efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:39.950524 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409a677-f354-4fb0-9fbe-5c0419e70efb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:39.963914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 600/1209] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:39.969956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab892c-8f3d-4d94-b661-37a235e5a4db admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:39.982034 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab892c-8f3d-4d94-b661-37a235e5a4db admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:39.987226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b1355-0e04-4131-b868-03581ba96541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:39.987998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b1355-0e04-4131-b868-03581ba96541 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:39.988346 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b1355-0e04-4131-b868-03581ba96541 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:39.988571 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b1355-0e04-4131-b868-03581ba96541 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:39.996787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b1355-0e04-4131-b868-03581ba96541 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:39.998838 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b1355-0e04-4131-b868-03581ba96541 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:40.013258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-596b1355-0e04-4131-b868-03581ba96541 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 24 16:40:40.014443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 610/1210] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:40.021167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409a677-f354-4fb0-9fbe-5c0419e70efb admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:40.032409 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409a677-f354-4fb0-9fbe-5c0419e70efb admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:40.036909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213cd07-5714-4e4b-ad38-7f533abf3847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:40.037595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213cd07-5714-4e4b-ad38-7f533abf3847 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:40.037882 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213cd07-5714-4e4b-ad38-7f533abf3847 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:40.038285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213cd07-5714-4e4b-ad38-7f533abf3847 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:40.039451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213cd07-5714-4e4b-ad38-7f533abf3847 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:40.039809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213cd07-5714-4e4b-ad38-7f533abf3847 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:40.042055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213cd07-5714-4e4b-ad38-7f533abf3847 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:40.062652 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 601/1211] 10.222.0.117 () {56 vars in 1169 bytes} [Mon Jan 24 16:40:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:40.068514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b1355-0e04-4131-b868-03581ba96541 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:40.079049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b1355-0e04-4131-b868-03581ba96541 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:40.083684 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fc37b-5b93-4137-b7b5-8a2c02ecb849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:40.084303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fc37b-5b93-4137-b7b5-8a2c02ecb849 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:40.084578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fc37b-5b93-4137-b7b5-8a2c02ecb849 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:40.084849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fc37b-5b93-4137-b7b5-8a2c02ecb849 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:40.092906 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fc37b-5b93-4137-b7b5-8a2c02ecb849 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:40.094689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fc37b-5b93-4137-b7b5-8a2c02ecb849 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:40.105638 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 611/1212] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:40:40 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:40:40.112087 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213cd07-5714-4e4b-ad38-7f533abf3847 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:40.122491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213cd07-5714-4e4b-ad38-7f533abf3847 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:40.128406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff7c5f-abd4-4a95-b38a-879134380239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:40.129236 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff7c5f-abd4-4a95-b38a-879134380239 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:40.129515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff7c5f-abd4-4a95-b38a-879134380239 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:40.129823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff7c5f-abd4-4a95-b38a-879134380239 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:40.144654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff7c5f-abd4-4a95-b38a-879134380239 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:40.148457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff7c5f-abd4-4a95-b38a-879134380239 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:40.169952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-abff7c5f-abd4-4a95-b38a-879134380239 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:40.171599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 602/1213] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:40:40.177294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fc37b-5b93-4137-b7b5-8a2c02ecb849 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:40.187803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fc37b-5b93-4137-b7b5-8a2c02ecb849 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:40.192985 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7990f3-373c-4870-a127-3d83485a97e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:40.193885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7990f3-373c-4870-a127-3d83485a97e6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:40.194321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7990f3-373c-4870-a127-3d83485a97e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:40.194777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7990f3-373c-4870-a127-3d83485a97e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:40.195712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7990f3-373c-4870-a127-3d83485a97e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:40.196225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7990f3-373c-4870-a127-3d83485a97e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:40.198698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7990f3-373c-4870-a127-3d83485a97e6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:40.212896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 612/1214] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:40.220034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff7c5f-abd4-4a95-b38a-879134380239 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:40.230726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff7c5f-abd4-4a95-b38a-879134380239 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:40.236599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5b6d-b675-4911-88cf-830262e41aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:40.239397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5b6d-b675-4911-88cf-830262e41aec admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:40.239397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5b6d-b675-4911-88cf-830262e41aec admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:40.239397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5b6d-b675-4911-88cf-830262e41aec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:40.246182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef5b6d-b675-4911-88cf-830262e41aec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:40.248612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef5b6d-b675-4911-88cf-830262e41aec admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:40.264037 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-0aef5b6d-b675-4911-88cf-830262e41aec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:40:40.265470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 603/1215] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:40:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:40.272213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7990f3-373c-4870-a127-3d83485a97e6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:40.284539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7990f3-373c-4870-a127-3d83485a97e6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:40.290784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435c6a3-8567-489c-a596-59d027d880dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:40.291472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c6a3-8567-489c-a596-59d027d880dd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:40.291759 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c6a3-8567-489c-a596-59d027d880dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:40.292532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c6a3-8567-489c-a596-59d027d880dd admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:40.293334 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c6a3-8567-489c-a596-59d027d880dd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:40.293644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c6a3-8567-489c-a596-59d027d880dd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:40.295804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c6a3-8567-489c-a596-59d027d880dd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:40.313243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 613/1216] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:40.320081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5b6d-b675-4911-88cf-830262e41aec admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:40.332209 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5b6d-b675-4911-88cf-830262e41aec admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:40.337685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350b07a-95c2-431f-8fbd-cb87e2c372a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:40.338460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b07a-95c2-431f-8fbd-cb87e2c372a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:40.338776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b07a-95c2-431f-8fbd-cb87e2c372a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:40.339109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b07a-95c2-431f-8fbd-cb87e2c372a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:40.340005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350b07a-95c2-431f-8fbd-cb87e2c372a8 admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=15975bd016ed48f9bf5c88845180ebf0) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:40.340328 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350b07a-95c2-431f-8fbd-cb87e2c372a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:40.343919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350b07a-95c2-431f-8fbd-cb87e2c372a8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:40.358804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 604/1217] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:40:40 2022] GET /identity/v3/role_assignments?user.id=15975bd016ed48f9bf5c88845180ebf0&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:40:42.746848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d4f94-9f90-4419-9ed7-baa580e716ea None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:42.746848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d4f94-9f90-4419-9ed7-baa580e716ea None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:42.746848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d4f94-9f90-4419-9ed7-baa580e716ea None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:42.748478 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 614/1218] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:40:42 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:40:42.753905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61301e0-34c9-4274-b726-0b2ccebd199a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:42.754337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61301e0-34c9-4274-b726-0b2ccebd199a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:42.754518 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61301e0-34c9-4274-b726-0b2ccebd199a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:42.771926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e61301e0-34c9-4274-b726-0b2ccebd199a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:40:42.773138 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e61301e0-34c9-4274-b726-0b2ccebd199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:40:42.782339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 605/1219] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:40:42 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:40:42.807134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d4f94-9f90-4419-9ed7-baa580e716ea None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:42.822811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d4f94-9f90-4419-9ed7-baa580e716ea None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:42.829649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a8c4c-1618-4af7-931a-2bbe4158c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:42.830959 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a8c4c-1618-4af7-931a-2bbe4158c625 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:42.831490 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a8c4c-1618-4af7-931a-2bbe4158c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:42.831973 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a8c4c-1618-4af7-931a-2bbe4158c625 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:42.847789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a8c4c-1618-4af7-931a-2bbe4158c625 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:40:42.856143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-097a8c4c-1618-4af7-931a-2bbe4158c625 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:40:42.857357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 615/1220] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:40:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:42.863464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61301e0-34c9-4274-b726-0b2ccebd199a None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:42.873078 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61301e0-34c9-4274-b726-0b2ccebd199a None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:42.879280 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d66fa7-1b3f-4bd5-8ac0-9854953666e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:42.880057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d66fa7-1b3f-4bd5-8ac0-9854953666e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:42.880556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d66fa7-1b3f-4bd5-8ac0-9854953666e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:42.880927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d66fa7-1b3f-4bd5-8ac0-9854953666e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:42.881766 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d66fa7-1b3f-4bd5-8ac0-9854953666e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:42.882141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d66fa7-1b3f-4bd5-8ac0-9854953666e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:42.884192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d66fa7-1b3f-4bd5-8ac0-9854953666e0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:42.894193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 606/1221] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:40:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:42.903566 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a8c4c-1618-4af7-931a-2bbe4158c625 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:42.917370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a8c4c-1618-4af7-931a-2bbe4158c625 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:42.923765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f21bf-f255-4451-9ee6-524786523cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:42.924663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f21bf-f255-4451-9ee6-524786523cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:42.926116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f21bf-f255-4451-9ee6-524786523cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:42.926705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f21bf-f255-4451-9ee6-524786523cb7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:42.938815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f21bf-f255-4451-9ee6-524786523cb7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:42.940948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f21bf-f255-4451-9ee6-524786523cb7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:42.962439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-0c5f21bf-f255-4451-9ee6-524786523cb7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:42.964341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 616/1222] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:42.970493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d66fa7-1b3f-4bd5-8ac0-9854953666e0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:42.981355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d66fa7-1b3f-4bd5-8ac0-9854953666e0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:42.987042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ddc1f-9a17-4f47-aa68-022b939ff568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:42.987719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ddc1f-9a17-4f47-aa68-022b939ff568 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:42.988015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ddc1f-9a17-4f47-aa68-022b939ff568 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:42.988387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ddc1f-9a17-4f47-aa68-022b939ff568 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:42.989620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ddc1f-9a17-4f47-aa68-022b939ff568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:42.989930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ddc1f-9a17-4f47-aa68-022b939ff568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:42.991883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ddc1f-9a17-4f47-aa68-022b939ff568 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:43.011097 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 607/1223] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:40:43.012093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f21bf-f255-4451-9ee6-524786523cb7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:43.021666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f21bf-f255-4451-9ee6-524786523cb7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:43.026722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f735eaa-c4b3-4158-88b0-80a895da9ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:43.027585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735eaa-c4b3-4158-88b0-80a895da9ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:43.027869 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735eaa-c4b3-4158-88b0-80a895da9ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:43.028180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735eaa-c4b3-4158-88b0-80a895da9ec5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:43.037159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f735eaa-c4b3-4158-88b0-80a895da9ec5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:43.039835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f735eaa-c4b3-4158-88b0-80a895da9ec5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:43.058289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-6f735eaa-c4b3-4158-88b0-80a895da9ec5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 24 16:40:43.066713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ddc1f-9a17-4f47-aa68-022b939ff568 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:43.067273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 617/1224] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:40:43.079465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ddc1f-9a17-4f47-aa68-022b939ff568 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:43.085428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b1398-ef4c-4357-b2f2-a852cb108415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:43.086193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b1398-ef4c-4357-b2f2-a852cb108415 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:43.086481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b1398-ef4c-4357-b2f2-a852cb108415 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:43.086759 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b1398-ef4c-4357-b2f2-a852cb108415 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:43.087633 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b1398-ef4c-4357-b2f2-a852cb108415 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:43.087935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b1398-ef4c-4357-b2f2-a852cb108415 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:43.090977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b1398-ef4c-4357-b2f2-a852cb108415 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:43.109470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 608/1225] 10.222.0.117 () {56 vars in 1169 bytes} [Mon Jan 24 16:40:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:43.114914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f735eaa-c4b3-4158-88b0-80a895da9ec5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:43.125210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f735eaa-c4b3-4158-88b0-80a895da9ec5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:43.131241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e96150-583c-48cf-8b8b-bbb5dd69ac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:43.132341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96150-583c-48cf-8b8b-bbb5dd69ac38 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:43.132460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96150-583c-48cf-8b8b-bbb5dd69ac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:43.132749 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96150-583c-48cf-8b8b-bbb5dd69ac38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:43.145714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e96150-583c-48cf-8b8b-bbb5dd69ac38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:43.147751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e96150-583c-48cf-8b8b-bbb5dd69ac38 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:43.172407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-13e96150-583c-48cf-8b8b-bbb5dd69ac38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:43.180135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 618/1226] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:43.180275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b1398-ef4c-4357-b2f2-a852cb108415 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:43.190973 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b1398-ef4c-4357-b2f2-a852cb108415 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:43.197788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830bce9-b338-44ef-9242-10fad06e7aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:43.198574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830bce9-b338-44ef-9242-10fad06e7aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:43.198885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830bce9-b338-44ef-9242-10fad06e7aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:43.199158 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830bce9-b338-44ef-9242-10fad06e7aa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:43.199907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830bce9-b338-44ef-9242-10fad06e7aa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:43.200207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830bce9-b338-44ef-9242-10fad06e7aa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:43.201859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830bce9-b338-44ef-9242-10fad06e7aa7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:43.214233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 609/1227] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:43.220581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e96150-583c-48cf-8b8b-bbb5dd69ac38 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:43.233259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e96150-583c-48cf-8b8b-bbb5dd69ac38 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:43.239449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97789e8e-6db9-40c6-b2a4-0278b5416280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:43.240423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97789e8e-6db9-40c6-b2a4-0278b5416280 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:43.240791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97789e8e-6db9-40c6-b2a4-0278b5416280 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:43.241729 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97789e8e-6db9-40c6-b2a4-0278b5416280 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:43.251372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97789e8e-6db9-40c6-b2a4-0278b5416280 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:43.253988 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97789e8e-6db9-40c6-b2a4-0278b5416280 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:43.270089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-97789e8e-6db9-40c6-b2a4-0278b5416280 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:40:43.271588 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 619/1228] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:43.279261 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830bce9-b338-44ef-9242-10fad06e7aa7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:43.289673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830bce9-b338-44ef-9242-10fad06e7aa7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:43.295850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140d043-9f80-419c-a5a3-66680f04df63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:43.296571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140d043-9f80-419c-a5a3-66680f04df63 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:43.296850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140d043-9f80-419c-a5a3-66680f04df63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:43.297131 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140d043-9f80-419c-a5a3-66680f04df63 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:43.298051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140d043-9f80-419c-a5a3-66680f04df63 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:43.298364 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140d043-9f80-419c-a5a3-66680f04df63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:43.300219 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140d043-9f80-419c-a5a3-66680f04df63 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:43.314338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 610/1229] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:40:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:43.321062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97789e8e-6db9-40c6-b2a4-0278b5416280 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:43.336224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97789e8e-6db9-40c6-b2a4-0278b5416280 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:43.342722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348bf71-4ba6-49e8-99b5-5a215d7caaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:43.343842 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348bf71-4ba6-49e8-99b5-5a215d7caaa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:43.344185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348bf71-4ba6-49e8-99b5-5a215d7caaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:43.344546 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348bf71-4ba6-49e8-99b5-5a215d7caaa0 admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/15975bd016ed48f9bf5c88845180ebf0/roles/adcc0add18bc4deebfb1e1785ed0297b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:43.366786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348bf71-4ba6-49e8-99b5-5a215d7caaa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=15975bd016ed48f9bf5c88845180ebf0, role_id=adcc0add18bc4deebfb1e1785ed0297b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:43.370194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348bf71-4ba6-49e8-99b5-5a215d7caaa0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:43.394367 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 620/1230] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:40:43 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/15975bd016ed48f9bf5c88845180ebf0/roles/adcc0add18bc4deebfb1e1785ed0297b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:40:45.845602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5dae-f8cc-45f9-84a4-8152f0fa7797 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:45.846172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5dae-f8cc-45f9-84a4-8152f0fa7797 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:45.846172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5dae-f8cc-45f9-84a4-8152f0fa7797 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:45.848072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 611/1231] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:40:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:40:45.854283 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e335-0d33-4ca5-ac5e-1df21f04a313 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:45.854725 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e335-0d33-4ca5-ac5e-1df21f04a313 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:45.854877 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e335-0d33-4ca5-ac5e-1df21f04a313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:45.874870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-8b79e335-0d33-4ca5-ac5e-1df21f04a313 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:40:45.876384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8b79e335-0d33-4ca5-ac5e-1df21f04a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:40:45.941022 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 621/1232] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:40:45 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:40:45.970841 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b5dae-f8cc-45f9-84a4-8152f0fa7797 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:45.984072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b5dae-f8cc-45f9-84a4-8152f0fa7797 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:45.988838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6556f4f-b826-4c1e-ba84-ed74e2f0acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:45.989641 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6556f4f-b826-4c1e-ba84-ed74e2f0acba admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:45.989923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6556f4f-b826-4c1e-ba84-ed74e2f0acba admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:45.990195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6556f4f-b826-4c1e-ba84-ed74e2f0acba admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.001235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6556f4f-b826-4c1e-ba84-ed74e2f0acba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:40:46.009793 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-a6556f4f-b826-4c1e-ba84-ed74e2f0acba admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 24 16:40:46.009793 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 612/1233] 10.222.0.117 () {56 vars in 1128 bytes} [Mon Jan 24 16:40:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:46.016761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79e335-0d33-4ca5-ac5e-1df21f04a313 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:46.025799 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79e335-0d33-4ca5-ac5e-1df21f04a313 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:46.030531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e24d5-ce92-490c-9b6f-b7e1450f5f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:46.031225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e24d5-ce92-490c-9b6f-b7e1450f5f36 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:46.031507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e24d5-ce92-490c-9b6f-b7e1450f5f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:46.031785 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e24d5-ce92-490c-9b6f-b7e1450f5f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.032540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e24d5-ce92-490c-9b6f-b7e1450f5f36 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:46.032845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e24d5-ce92-490c-9b6f-b7e1450f5f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:46.034424 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e24d5-ce92-490c-9b6f-b7e1450f5f36 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:46.043597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 622/1234] 10.222.0.117 () {56 vars in 1129 bytes} [Mon Jan 24 16:40:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:46.049357 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6556f4f-b826-4c1e-ba84-ed74e2f0acba admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:46.061256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6556f4f-b826-4c1e-ba84-ed74e2f0acba admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:46.065984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b330ecc-c221-4037-a992-070bd047e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:46.066740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330ecc-c221-4037-a992-070bd047e34a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:46.067047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330ecc-c221-4037-a992-070bd047e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:46.067311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330ecc-c221-4037-a992-070bd047e34a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.078257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b330ecc-c221-4037-a992-070bd047e34a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:46.080108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b330ecc-c221-4037-a992-070bd047e34a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:46.101742 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-2b330ecc-c221-4037-a992-070bd047e34a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:46.103426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 613/1235] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:46.109734 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e24d5-ce92-490c-9b6f-b7e1450f5f36 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:46.120409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e24d5-ce92-490c-9b6f-b7e1450f5f36 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:46.124992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e7f15-2bdc-4650-a3a2-f15d69e43512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:46.125718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e7f15-2bdc-4650-a3a2-f15d69e43512 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:46.126070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e7f15-2bdc-4650-a3a2-f15d69e43512 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:46.126416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e7f15-2bdc-4650-a3a2-f15d69e43512 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.127239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e7f15-2bdc-4650-a3a2-f15d69e43512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:46.127612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e7f15-2bdc-4650-a3a2-f15d69e43512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:46.129253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e7f15-2bdc-4650-a3a2-f15d69e43512 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:46.142378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 623/1236] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:46.148877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b330ecc-c221-4037-a992-070bd047e34a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:46.159827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b330ecc-c221-4037-a992-070bd047e34a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:46.165544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae78f4f-f2df-4917-a7d9-025e53560d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:46.166356 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae78f4f-f2df-4917-a7d9-025e53560d28 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:46.167178 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae78f4f-f2df-4917-a7d9-025e53560d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:46.167457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae78f4f-f2df-4917-a7d9-025e53560d28 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.175302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae78f4f-f2df-4917-a7d9-025e53560d28 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:46.177304 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae78f4f-f2df-4917-a7d9-025e53560d28 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:46.191153 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-cae78f4f-f2df-4917-a7d9-025e53560d28 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 24 16:40:46.192302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 614/1237] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:40:46.198820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e7f15-2bdc-4650-a3a2-f15d69e43512 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:46.209424 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e7f15-2bdc-4650-a3a2-f15d69e43512 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:46.214636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1eb2c-c40d-44d8-977a-cfacabadb299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:46.215304 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1eb2c-c40d-44d8-977a-cfacabadb299 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:46.215656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1eb2c-c40d-44d8-977a-cfacabadb299 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:46.215841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1eb2c-c40d-44d8-977a-cfacabadb299 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.216686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1eb2c-c40d-44d8-977a-cfacabadb299 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:46.217004 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1eb2c-c40d-44d8-977a-cfacabadb299 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:46.218908 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1eb2c-c40d-44d8-977a-cfacabadb299 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:46.237092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 624/1238] 10.222.0.117 () {56 vars in 1169 bytes} [Mon Jan 24 16:40:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:46.244508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae78f4f-f2df-4917-a7d9-025e53560d28 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:46.255690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae78f4f-f2df-4917-a7d9-025e53560d28 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:46.261708 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba56e1a-fae0-4cb8-b5ec-16e932227f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:46.262499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba56e1a-fae0-4cb8-b5ec-16e932227f66 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:46.262818 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba56e1a-fae0-4cb8-b5ec-16e932227f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:46.263154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba56e1a-fae0-4cb8-b5ec-16e932227f66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.272359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba56e1a-fae0-4cb8-b5ec-16e932227f66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:46.274424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba56e1a-fae0-4cb8-b5ec-16e932227f66 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:46.285230 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 615/1239] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:40:46 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:40:46.291155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1eb2c-c40d-44d8-977a-cfacabadb299 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:46.301365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1eb2c-c40d-44d8-977a-cfacabadb299 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:46.306159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da61361-1354-4f27-98b8-2bc16e861a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:46.306969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da61361-1354-4f27-98b8-2bc16e861a07 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:46.307374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da61361-1354-4f27-98b8-2bc16e861a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:46.307653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da61361-1354-4f27-98b8-2bc16e861a07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.318288 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da61361-1354-4f27-98b8-2bc16e861a07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:46.320791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da61361-1354-4f27-98b8-2bc16e861a07 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:46.339941 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-8da61361-1354-4f27-98b8-2bc16e861a07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:46.347138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 625/1240] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:46.348336 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba56e1a-fae0-4cb8-b5ec-16e932227f66 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:46.359333 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba56e1a-fae0-4cb8-b5ec-16e932227f66 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:46.366328 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c62e4f-a4ea-402c-b65c-3d16e105a62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:46.367259 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c62e4f-a4ea-402c-b65c-3d16e105a62e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:46.367729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c62e4f-a4ea-402c-b65c-3d16e105a62e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:46.368334 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c62e4f-a4ea-402c-b65c-3d16e105a62e admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.369543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c62e4f-a4ea-402c-b65c-3d16e105a62e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:46.370450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c62e4f-a4ea-402c-b65c-3d16e105a62e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:46.372956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c62e4f-a4ea-402c-b65c-3d16e105a62e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:46.387631 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 616/1241] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:46.395229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da61361-1354-4f27-98b8-2bc16e861a07 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:46.405758 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da61361-1354-4f27-98b8-2bc16e861a07 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:46.410926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84ec62-8d11-4faf-aa03-37d1d2d11a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:46.411878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ec62-8d11-4faf-aa03-37d1d2d11a26 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:46.412164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ec62-8d11-4faf-aa03-37d1d2d11a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:46.412438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ec62-8d11-4faf-aa03-37d1d2d11a26 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.421063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84ec62-8d11-4faf-aa03-37d1d2d11a26 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:46.423619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84ec62-8d11-4faf-aa03-37d1d2d11a26 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:46.440878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-4d84ec62-8d11-4faf-aa03-37d1d2d11a26 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:40:46.442140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 626/1242] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:46.448777 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c62e4f-a4ea-402c-b65c-3d16e105a62e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:46.458421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c62e4f-a4ea-402c-b65c-3d16e105a62e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:46.463121 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7123aa7-57f0-4bd0-bea8-3d1093956580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:46.464368 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7123aa7-57f0-4bd0-bea8-3d1093956580 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:46.464828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7123aa7-57f0-4bd0-bea8-3d1093956580 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:46.465084 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7123aa7-57f0-4bd0-bea8-3d1093956580 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.465877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7123aa7-57f0-4bd0-bea8-3d1093956580 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:46.466184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7123aa7-57f0-4bd0-bea8-3d1093956580 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:46.468090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7123aa7-57f0-4bd0-bea8-3d1093956580 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:46.482772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 617/1243] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:40:46.489277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84ec62-8d11-4faf-aa03-37d1d2d11a26 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:46.507185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84ec62-8d11-4faf-aa03-37d1d2d11a26 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:46.513569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60feaa-5bc5-4847-a321-d6589a624bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:46.514272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60feaa-5bc5-4847-a321-d6589a624bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:46.514551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60feaa-5bc5-4847-a321-d6589a624bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:46.514849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60feaa-5bc5-4847-a321-d6589a624bc3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:46.515689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60feaa-5bc5-4847-a321-d6589a624bc3 admin admin] RBAC: Adding query filter params (role.id=adcc0add18bc4deebfb1e1785ed0297b, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=15975bd016ed48f9bf5c88845180ebf0) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:46.515992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60feaa-5bc5-4847-a321-d6589a624bc3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:46.517926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60feaa-5bc5-4847-a321-d6589a624bc3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:46.524659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 627/1244] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:40:46 2022] GET /identity/v3/role_assignments?user.id=15975bd016ed48f9bf5c88845180ebf0&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=adcc0add18bc4deebfb1e1785ed0297b => generated 610 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:40:48.923394 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935140b4-099e-41a8-9860-753b9a76c0c3 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:48.923976 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935140b4-099e-41a8-9860-753b9a76c0c3 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:48.923976 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935140b4-099e-41a8-9860-753b9a76c0c3 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:48.925950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 618/1245] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:40:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:40:48.932376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39c86-2535-4c1f-b3ab-a1b2a0307c8c None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:48.932834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39c86-2535-4c1f-b3ab-a1b2a0307c8c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:48.932928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39c86-2535-4c1f-b3ab-a1b2a0307c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:48.952434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-58c39c86-2535-4c1f-b3ab-a1b2a0307c8c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:40:48.953902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-58c39c86-2535-4c1f-b3ab-a1b2a0307c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:40:48.962921 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 628/1246] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:40:48 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:40:48.990024 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935140b4-099e-41a8-9860-753b9a76c0c3 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.006839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935140b4-099e-41a8-9860-753b9a76c0c3 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.012224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350ed9d-15b1-4a7a-9f25-6ff5e4825e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.013142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350ed9d-15b1-4a7a-9f25-6ff5e4825e35 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.013428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350ed9d-15b1-4a7a-9f25-6ff5e4825e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.013769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350ed9d-15b1-4a7a-9f25-6ff5e4825e35 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.025748 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350ed9d-15b1-4a7a-9f25-6ff5e4825e35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:40:49.033279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-6350ed9d-15b1-4a7a-9f25-6ff5e4825e35 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:40:49.034601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 619/1247] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:49.041087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c39c86-2535-4c1f-b3ab-a1b2a0307c8c None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.050791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c39c86-2535-4c1f-b3ab-a1b2a0307c8c None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.056690 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152b70e-8132-4a2c-a911-04e152ebbc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.058231 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152b70e-8132-4a2c-a911-04e152ebbc84 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.058951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152b70e-8132-4a2c-a911-04e152ebbc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.059358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152b70e-8132-4a2c-a911-04e152ebbc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.060265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152b70e-8132-4a2c-a911-04e152ebbc84 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:49.060679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152b70e-8132-4a2c-a911-04e152ebbc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:49.063116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152b70e-8132-4a2c-a911-04e152ebbc84 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:49.076387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 629/1248] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:40:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:49.081826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350ed9d-15b1-4a7a-9f25-6ff5e4825e35 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.092129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350ed9d-15b1-4a7a-9f25-6ff5e4825e35 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.096847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4b1d0-aca9-4145-b229-a957ad1e0cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.097616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4b1d0-aca9-4145-b229-a957ad1e0cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.097898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4b1d0-aca9-4145-b229-a957ad1e0cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.098177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4b1d0-aca9-4145-b229-a957ad1e0cf3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.111528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4b1d0-aca9-4145-b229-a957ad1e0cf3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:49.113353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4b1d0-aca9-4145-b229-a957ad1e0cf3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:49.130172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-75d4b1d0-aca9-4145-b229-a957ad1e0cf3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:49.131358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 620/1249] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:40:49.138109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152b70e-8132-4a2c-a911-04e152ebbc84 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.150139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152b70e-8132-4a2c-a911-04e152ebbc84 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.155990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407914f4-2b40-4b82-98b5-4281283df312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.156804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407914f4-2b40-4b82-98b5-4281283df312 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.157147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407914f4-2b40-4b82-98b5-4281283df312 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.157550 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407914f4-2b40-4b82-98b5-4281283df312 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.158447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407914f4-2b40-4b82-98b5-4281283df312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:49.158764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407914f4-2b40-4b82-98b5-4281283df312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:49.160748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407914f4-2b40-4b82-98b5-4281283df312 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:49.175558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 630/1250] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:49.182779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4b1d0-aca9-4145-b229-a957ad1e0cf3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.192431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4b1d0-aca9-4145-b229-a957ad1e0cf3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.196955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a41459-809d-4f57-9d86-7d113ce1439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.198799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a41459-809d-4f57-9d86-7d113ce1439e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.199089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a41459-809d-4f57-9d86-7d113ce1439e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.199363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a41459-809d-4f57-9d86-7d113ce1439e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.207527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a41459-809d-4f57-9d86-7d113ce1439e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:49.209541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a41459-809d-4f57-9d86-7d113ce1439e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:49.226839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-f8a41459-809d-4f57-9d86-7d113ce1439e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 24 16:40:49.228076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 621/1251] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:49.235160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407914f4-2b40-4b82-98b5-4281283df312 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.246901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407914f4-2b40-4b82-98b5-4281283df312 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.251724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a6785-1d2d-4527-8544-0c1d68b4dccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.252470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a6785-1d2d-4527-8544-0c1d68b4dccc admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.252761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a6785-1d2d-4527-8544-0c1d68b4dccc admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.253066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a6785-1d2d-4527-8544-0c1d68b4dccc admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.254016 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a6785-1d2d-4527-8544-0c1d68b4dccc admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:49.254292 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a6785-1d2d-4527-8544-0c1d68b4dccc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:49.256337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a6785-1d2d-4527-8544-0c1d68b4dccc admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:49.282952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 631/1252] 10.222.0.117 () {56 vars in 1169 bytes} [Mon Jan 24 16:40:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:49.284127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a41459-809d-4f57-9d86-7d113ce1439e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.294726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a41459-809d-4f57-9d86-7d113ce1439e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.299237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ae612-a5ed-4456-bced-071f26ae7fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.299872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae612-a5ed-4456-bced-071f26ae7fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.300141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae612-a5ed-4456-bced-071f26ae7fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.300409 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae612-a5ed-4456-bced-071f26ae7fa4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.310331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ae612-a5ed-4456-bced-071f26ae7fa4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:49.312342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ae612-a5ed-4456-bced-071f26ae7fa4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:49.328325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 622/1253] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:40:49 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:40:49.334364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a6785-1d2d-4527-8544-0c1d68b4dccc admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.346783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a6785-1d2d-4527-8544-0c1d68b4dccc admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.352712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23152a7e-4dc3-483c-9f73-4d5587441cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.353693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23152a7e-4dc3-483c-9f73-4d5587441cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.354052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23152a7e-4dc3-483c-9f73-4d5587441cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.354385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23152a7e-4dc3-483c-9f73-4d5587441cf6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.367729 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23152a7e-4dc3-483c-9f73-4d5587441cf6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:49.369876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23152a7e-4dc3-483c-9f73-4d5587441cf6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:49.388912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-23152a7e-4dc3-483c-9f73-4d5587441cf6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:49.390254 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 632/1254] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:49.396335 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ae612-a5ed-4456-bced-071f26ae7fa4 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.407866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ae612-a5ed-4456-bced-071f26ae7fa4 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.412906 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf9b93-a64e-44c4-b66c-5442bd3d38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.413970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf9b93-a64e-44c4-b66c-5442bd3d38bd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.414301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf9b93-a64e-44c4-b66c-5442bd3d38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.414606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf9b93-a64e-44c4-b66c-5442bd3d38bd admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.415587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf9b93-a64e-44c4-b66c-5442bd3d38bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:49.415937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf9b93-a64e-44c4-b66c-5442bd3d38bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:49.417818 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf9b93-a64e-44c4-b66c-5442bd3d38bd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:49.431789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 623/1255] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:49.437357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23152a7e-4dc3-483c-9f73-4d5587441cf6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.448794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23152a7e-4dc3-483c-9f73-4d5587441cf6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.453964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcef62-30a1-41ec-9ac6-c84a1ef7df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.454731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcef62-30a1-41ec-9ac6-c84a1ef7df0d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.455037 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcef62-30a1-41ec-9ac6-c84a1ef7df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.455314 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcef62-30a1-41ec-9ac6-c84a1ef7df0d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.463101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcef62-30a1-41ec-9ac6-c84a1ef7df0d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:49.466136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcef62-30a1-41ec-9ac6-c84a1ef7df0d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:49.481963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-64bcef62-30a1-41ec-9ac6-c84a1ef7df0d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:40:49.483368 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 633/1256] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:40:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:49.490299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf9b93-a64e-44c4-b66c-5442bd3d38bd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.502120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf9b93-a64e-44c4-b66c-5442bd3d38bd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.507596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7061fe-eedf-4d47-940c-fa7cec2a05bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.508334 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7061fe-eedf-4d47-940c-fa7cec2a05bc admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.508680 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7061fe-eedf-4d47-940c-fa7cec2a05bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.509020 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7061fe-eedf-4d47-940c-fa7cec2a05bc admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.509831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7061fe-eedf-4d47-940c-fa7cec2a05bc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:49.510791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7061fe-eedf-4d47-940c-fa7cec2a05bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:49.512727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7061fe-eedf-4d47-940c-fa7cec2a05bc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:49.526035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 624/1257] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:40:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:49.533679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcef62-30a1-41ec-9ac6-c84a1ef7df0d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:49.545700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcef62-30a1-41ec-9ac6-c84a1ef7df0d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:49.559118 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bf9a2-44ad-4e90-8233-a051afae2ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:49.559815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bf9a2-44ad-4e90-8233-a051afae2ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:49.560140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bf9a2-44ad-4e90-8233-a051afae2ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:49.560458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bf9a2-44ad-4e90-8233-a051afae2ef6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:49.565221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bf9a2-44ad-4e90-8233-a051afae2ef6 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=15975bd016ed48f9bf5c88845180ebf0) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:49.565613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bf9a2-44ad-4e90-8233-a051afae2ef6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:49.567865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bf9a2-44ad-4e90-8233-a051afae2ef6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:49.575522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 634/1258] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:40:49 2022] GET /identity/v3/role_assignments?user.id=15975bd016ed48f9bf5c88845180ebf0&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:52.079349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f69b-0a30-439a-bd87-d09faa89353a None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.080006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f69b-0a30-439a-bd87-d09faa89353a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.080006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f69b-0a30-439a-bd87-d09faa89353a None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.081641 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 625/1259] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:40:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:40:52.086909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee354a-3776-4ead-956f-6654a872c211 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.087379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee354a-3776-4ead-956f-6654a872c211 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.087471 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee354a-3776-4ead-956f-6654a872c211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.106388 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-2cee354a-3776-4ead-956f-6654a872c211 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:40:52.107608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2cee354a-3776-4ead-956f-6654a872c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:40:52.115451 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 635/1260] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:40:52 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:40:52.140240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429f69b-0a30-439a-bd87-d09faa89353a None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:52.155224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429f69b-0a30-439a-bd87-d09faa89353a None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:52.161593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e25e0-b34d-4b3c-88bd-8f0885b150bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:52.162848 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e25e0-b34d-4b3c-88bd-8f0885b150bb admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.163335 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e25e0-b34d-4b3c-88bd-8f0885b150bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.163611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e25e0-b34d-4b3c-88bd-8f0885b150bb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.175358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e25e0-b34d-4b3c-88bd-8f0885b150bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:40:52.182829 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-a31e25e0-b34d-4b3c-88bd-8f0885b150bb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:40:52.183906 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 626/1261] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:40:52.189953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee354a-3776-4ead-956f-6654a872c211 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:52.200232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee354a-3776-4ead-956f-6654a872c211 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:52.205477 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ed03d-fb7f-44b9-aeba-342742ebf17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:52.206289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ed03d-fb7f-44b9-aeba-342742ebf17d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.206616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ed03d-fb7f-44b9-aeba-342742ebf17d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.206960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ed03d-fb7f-44b9-aeba-342742ebf17d admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.207781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ed03d-fb7f-44b9-aeba-342742ebf17d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:52.208153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ed03d-fb7f-44b9-aeba-342742ebf17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:52.209825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ed03d-fb7f-44b9-aeba-342742ebf17d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:52.225330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 636/1262] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:40:52 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:52.226768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e25e0-b34d-4b3c-88bd-8f0885b150bb admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:52.238327 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e25e0-b34d-4b3c-88bd-8f0885b150bb admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:52.243463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100dc55-c88f-4834-b884-e63b3bd6e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:52.244391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100dc55-c88f-4834-b884-e63b3bd6e951 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.244888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100dc55-c88f-4834-b884-e63b3bd6e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.245005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100dc55-c88f-4834-b884-e63b3bd6e951 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.256638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100dc55-c88f-4834-b884-e63b3bd6e951 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:52.258735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100dc55-c88f-4834-b884-e63b3bd6e951 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:52.276604 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-3100dc55-c88f-4834-b884-e63b3bd6e951 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:52.277859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 627/1263] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:52.283885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ed03d-fb7f-44b9-aeba-342742ebf17d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:52.295262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ed03d-fb7f-44b9-aeba-342742ebf17d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:52.300094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80de3e-aac7-49e0-b763-93976d24af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:52.300810 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80de3e-aac7-49e0-b763-93976d24af99 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.301094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80de3e-aac7-49e0-b763-93976d24af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.301377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80de3e-aac7-49e0-b763-93976d24af99 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.302201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80de3e-aac7-49e0-b763-93976d24af99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:52.302508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80de3e-aac7-49e0-b763-93976d24af99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:52.304169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80de3e-aac7-49e0-b763-93976d24af99 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:52.319947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 637/1264] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:52.325457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100dc55-c88f-4834-b884-e63b3bd6e951 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:52.335927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100dc55-c88f-4834-b884-e63b3bd6e951 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:52.341163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8cb28-2367-428b-8607-6862eef8a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:52.342031 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8cb28-2367-428b-8607-6862eef8a579 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.342322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8cb28-2367-428b-8607-6862eef8a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.342618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8cb28-2367-428b-8607-6862eef8a579 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.351915 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8cb28-2367-428b-8607-6862eef8a579 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:52.354830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8cb28-2367-428b-8607-6862eef8a579 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:52.371228 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-09d8cb28-2367-428b-8607-6862eef8a579 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 24 16:40:52.372801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 628/1265] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:52.378735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80de3e-aac7-49e0-b763-93976d24af99 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:52.391834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80de3e-aac7-49e0-b763-93976d24af99 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:52.397685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532177d-e6b6-462e-960a-1c3206821264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:52.398668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532177d-e6b6-462e-960a-1c3206821264 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.399071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532177d-e6b6-462e-960a-1c3206821264 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.399387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532177d-e6b6-462e-960a-1c3206821264 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.400563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532177d-e6b6-462e-960a-1c3206821264 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:52.401432 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532177d-e6b6-462e-960a-1c3206821264 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:52.404059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532177d-e6b6-462e-960a-1c3206821264 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:52.427319 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 638/1266] 10.222.0.117 () {56 vars in 1169 bytes} [Mon Jan 24 16:40:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:52.433685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8cb28-2367-428b-8607-6862eef8a579 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:52.443378 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8cb28-2367-428b-8607-6862eef8a579 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:52.448182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270ac44-134d-4446-95f4-dce20099c448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:52.448997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270ac44-134d-4446-95f4-dce20099c448 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.449264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270ac44-134d-4446-95f4-dce20099c448 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.449538 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270ac44-134d-4446-95f4-dce20099c448 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.463267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270ac44-134d-4446-95f4-dce20099c448 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:52.465110 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270ac44-134d-4446-95f4-dce20099c448 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:52.485374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-a270ac44-134d-4446-95f4-dce20099c448 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:52.487391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 629/1267] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:52.492989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532177d-e6b6-462e-960a-1c3206821264 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:52.503937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532177d-e6b6-462e-960a-1c3206821264 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:52.509244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa941397-48f5-4dae-a837-b6d61c12042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:52.510530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa941397-48f5-4dae-a837-b6d61c12042b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.510935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa941397-48f5-4dae-a837-b6d61c12042b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.511321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa941397-48f5-4dae-a837-b6d61c12042b admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.512284 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa941397-48f5-4dae-a837-b6d61c12042b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:52.512664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa941397-48f5-4dae-a837-b6d61c12042b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:52.514306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa941397-48f5-4dae-a837-b6d61c12042b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:52.528167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 639/1268] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:52.535707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270ac44-134d-4446-95f4-dce20099c448 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:52.547146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270ac44-134d-4446-95f4-dce20099c448 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:52.551811 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae5001-9ce3-43fb-af06-cc16f45a4aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:52.552566 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5001-9ce3-43fb-af06-cc16f45a4aca admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.552844 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5001-9ce3-43fb-af06-cc16f45a4aca admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.553110 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5001-9ce3-43fb-af06-cc16f45a4aca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.560999 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae5001-9ce3-43fb-af06-cc16f45a4aca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:52.563195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae5001-9ce3-43fb-af06-cc16f45a4aca admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:52.578510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-4cae5001-9ce3-43fb-af06-cc16f45a4aca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:40:52.579766 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 630/1269] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:40:52.586835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa941397-48f5-4dae-a837-b6d61c12042b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:52.598546 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa941397-48f5-4dae-a837-b6d61c12042b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:52.603389 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002b505-8dc4-4766-affc-bfabaf5f3edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:52.604823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b505-8dc4-4766-affc-bfabaf5f3edd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.605098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b505-8dc4-4766-affc-bfabaf5f3edd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.605371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b505-8dc4-4766-affc-bfabaf5f3edd admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.606194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002b505-8dc4-4766-affc-bfabaf5f3edd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:52.606494 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002b505-8dc4-4766-affc-bfabaf5f3edd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:52.608379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002b505-8dc4-4766-affc-bfabaf5f3edd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:52.626349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 640/1270] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:40:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:52.627523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae5001-9ce3-43fb-af06-cc16f45a4aca admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:52.639056 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae5001-9ce3-43fb-af06-cc16f45a4aca admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:52.646430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8713ae-014b-4735-b85e-2260822cb3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:52.648217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8713ae-014b-4735-b85e-2260822cb3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:52.648737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8713ae-014b-4735-b85e-2260822cb3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:52.649334 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8713ae-014b-4735-b85e-2260822cb3f0 admin admin] PATH_INFO: `/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/15975bd016ed48f9bf5c88845180ebf0/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:52.654080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8713ae-014b-4735-b85e-2260822cb3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec70d8afc7144bd9fc12156d01e6855, user_id=15975bd016ed48f9bf5c88845180ebf0, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:52.658229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8713ae-014b-4735-b85e-2260822cb3f0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:52.675192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 631/1271] 10.222.0.117 () {58 vars in 1465 bytes} [Mon Jan 24 16:40:52 2022] PUT /identity/v3/projects/7ec70d8afc7144bd9fc12156d01e6855/users/15975bd016ed48f9bf5c88845180ebf0/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:40:55.133464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09c227-7018-4776-9bd8-44b09c3359b1 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.134101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09c227-7018-4776-9bd8-44b09c3359b1 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.134101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09c227-7018-4776-9bd8-44b09c3359b1 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.137598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 641/1272] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:40:55 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:40:55.142433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f9a88-3af5-48ec-a879-cec2e773dc75 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.142911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f9a88-3af5-48ec-a879-cec2e773dc75 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.143011 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f9a88-3af5-48ec-a879-cec2e773dc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.161089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-5a6f9a88-3af5-48ec-a879-cec2e773dc75 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:40:55.162271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5a6f9a88-3af5-48ec-a879-cec2e773dc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:40:55.217662 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 632/1273] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:40:55 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:40:55.242455 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09c227-7018-4776-9bd8-44b09c3359b1 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.254937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09c227-7018-4776-9bd8-44b09c3359b1 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.259237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c169d6c-69c3-4505-a1d7-97e4c2b8a156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.260551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169d6c-69c3-4505-a1d7-97e4c2b8a156 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.260811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169d6c-69c3-4505-a1d7-97e4c2b8a156 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.261081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169d6c-69c3-4505-a1d7-97e4c2b8a156 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.271059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c169d6c-69c3-4505-a1d7-97e4c2b8a156 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 24 16:40:55.278440 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-5c169d6c-69c3-4505-a1d7-97e4c2b8a156 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 24 16:40:55.279603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 642/1274] 10.222.0.117 () {56 vars in 1122 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:55.285473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f9a88-3af5-48ec-a879-cec2e773dc75 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.294442 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f9a88-3af5-48ec-a879-cec2e773dc75 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.298969 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1e8f0-0ac8-4421-a4b4-a5241d0a2ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.299611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1e8f0-0ac8-4421-a4b4-a5241d0a2ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.299890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1e8f0-0ac8-4421-a4b4-a5241d0a2ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.300164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1e8f0-0ac8-4421-a4b4-a5241d0a2ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.300918 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1e8f0-0ac8-4421-a4b4-a5241d0a2ea2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:55.301222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1e8f0-0ac8-4421-a4b4-a5241d0a2ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:55.302824 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1e8f0-0ac8-4421-a4b4-a5241d0a2ea2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:55.310771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 633/1275] 10.222.0.117 () {56 vars in 1125 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:40:55.315963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c169d6c-69c3-4505-a1d7-97e4c2b8a156 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.326429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c169d6c-69c3-4505-a1d7-97e4c2b8a156 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.330994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1db0d-cee7-41ab-a36a-5d1f03c74f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.331747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1db0d-cee7-41ab-a36a-5d1f03c74f8d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.332026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1db0d-cee7-41ab-a36a-5d1f03c74f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.332299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1db0d-cee7-41ab-a36a-5d1f03c74f8d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.343346 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1db0d-cee7-41ab-a36a-5d1f03c74f8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:55.345425 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1db0d-cee7-41ab-a36a-5d1f03c74f8d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:55.363237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-29c1db0d-cee7-41ab-a36a-5d1f03c74f8d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:55.364620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 643/1276] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:55.370410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1e8f0-0ac8-4421-a4b4-a5241d0a2ea2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.381414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1e8f0-0ac8-4421-a4b4-a5241d0a2ea2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.388109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6910ae-7a41-48c5-b779-66250858d911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.388832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6910ae-7a41-48c5-b779-66250858d911 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.389203 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6910ae-7a41-48c5-b779-66250858d911 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.389566 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6910ae-7a41-48c5-b779-66250858d911 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.390456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6910ae-7a41-48c5-b779-66250858d911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:55.390928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6910ae-7a41-48c5-b779-66250858d911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:55.392736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6910ae-7a41-48c5-b779-66250858d911 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:55.405466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 634/1277] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:55.411027 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1db0d-cee7-41ab-a36a-5d1f03c74f8d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.421042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1db0d-cee7-41ab-a36a-5d1f03c74f8d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.425551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2e3e8-ac02-4e27-9613-8caf10ed1bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.426319 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2e3e8-ac02-4e27-9613-8caf10ed1bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.426601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2e3e8-ac02-4e27-9613-8caf10ed1bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.426909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2e3e8-ac02-4e27-9613-8caf10ed1bf5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.434186 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2e3e8-ac02-4e27-9613-8caf10ed1bf5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:55.436212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2e3e8-ac02-4e27-9613-8caf10ed1bf5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:55.450698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-4ad2e3e8-ac02-4e27-9613-8caf10ed1bf5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 24 16:40:55.451834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 644/1278] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:55.457133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6910ae-7a41-48c5-b779-66250858d911 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.467134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6910ae-7a41-48c5-b779-66250858d911 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.471773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b645e0e-9a6c-43f7-8481-377fea20fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.472406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b645e0e-9a6c-43f7-8481-377fea20fd7a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.472682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b645e0e-9a6c-43f7-8481-377fea20fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.472954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b645e0e-9a6c-43f7-8481-377fea20fd7a admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.473785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b645e0e-9a6c-43f7-8481-377fea20fd7a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:55.474088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b645e0e-9a6c-43f7-8481-377fea20fd7a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:55.475916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b645e0e-9a6c-43f7-8481-377fea20fd7a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:55.492732 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 635/1279] 10.222.0.117 () {56 vars in 1169 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:55.498192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2e3e8-ac02-4e27-9613-8caf10ed1bf5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.507555 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2e3e8-ac02-4e27-9613-8caf10ed1bf5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.512562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb3498-8ce3-437d-bee7-3472356736a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.513180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3498-8ce3-437d-bee7-3472356736a3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.513464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3498-8ce3-437d-bee7-3472356736a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.513741 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3498-8ce3-437d-bee7-3472356736a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.521359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb3498-8ce3-437d-bee7-3472356736a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:55.523121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb3498-8ce3-437d-bee7-3472356736a3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:55.531826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 645/1280] 10.222.0.117 () {58 vars in 1329 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:40:55.537009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b645e0e-9a6c-43f7-8481-377fea20fd7a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.546157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b645e0e-9a6c-43f7-8481-377fea20fd7a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.550556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c81d9-07e6-4f03-a001-ec9bf5b2fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.551355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c81d9-07e6-4f03-a001-ec9bf5b2fb40 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.551621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c81d9-07e6-4f03-a001-ec9bf5b2fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.551892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c81d9-07e6-4f03-a001-ec9bf5b2fb40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.562379 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c81d9-07e6-4f03-a001-ec9bf5b2fb40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:55.564226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c81d9-07e6-4f03-a001-ec9bf5b2fb40 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:55.580214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-905c81d9-07e6-4f03-a001-ec9bf5b2fb40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 24 16:40:55.581308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 636/1281] 10.222.0.117 () {56 vars in 1134 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 24 16:40:55.586645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb3498-8ce3-437d-bee7-3472356736a3 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.596074 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb3498-8ce3-437d-bee7-3472356736a3 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.600680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d81e-1f2f-480b-9953-17f5b0b97755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.601308 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d81e-1f2f-480b-9953-17f5b0b97755 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.601588 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d81e-1f2f-480b-9953-17f5b0b97755 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.601861 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d81e-1f2f-480b-9953-17f5b0b97755 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.602581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d81e-1f2f-480b-9953-17f5b0b97755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:55.602922 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d81e-1f2f-480b-9953-17f5b0b97755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:55.605116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d81e-1f2f-480b-9953-17f5b0b97755 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:55.616189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 646/1282] 10.222.0.117 () {56 vars in 1135 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:55.621603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c81d9-07e6-4f03-a001-ec9bf5b2fb40 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.630976 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c81d9-07e6-4f03-a001-ec9bf5b2fb40 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.635344 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5ea9d-e7c9-4483-aef9-bff8179bceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.636097 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5ea9d-e7c9-4483-aef9-bff8179bceb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.636372 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5ea9d-e7c9-4483-aef9-bff8179bceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.636643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5ea9d-e7c9-4483-aef9-bff8179bceb2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.643295 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5ea9d-e7c9-4483-aef9-bff8179bceb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:55.645226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5ea9d-e7c9-4483-aef9-bff8179bceb2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:55.658216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING keystone.server.flask.application [None req-47a5ea9d-e7c9-4483-aef9-bff8179bceb2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 24 16:40:55.659369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 637/1283] 10.222.0.117 () {56 vars in 1137 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:55.665124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d81e-1f2f-480b-9953-17f5b0b97755 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.675414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d81e-1f2f-480b-9953-17f5b0b97755 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.679883 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad751f0-0c96-4b1b-a03b-00dca3136fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.680512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad751f0-0c96-4b1b-a03b-00dca3136fdd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.680793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad751f0-0c96-4b1b-a03b-00dca3136fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.681067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad751f0-0c96-4b1b-a03b-00dca3136fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.681883 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad751f0-0c96-4b1b-a03b-00dca3136fdd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:55.682186 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad751f0-0c96-4b1b-a03b-00dca3136fdd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:55.684032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad751f0-0c96-4b1b-a03b-00dca3136fdd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:55.695578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 647/1284] 10.222.0.117 () {56 vars in 1174 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:55.701277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5ea9d-e7c9-4483-aef9-bff8179bceb2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:55.711428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5ea9d-e7c9-4483-aef9-bff8179bceb2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:55.717123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb450fd-abea-4cca-94fb-0746e3606a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:55.717746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb450fd-abea-4cca-94fb-0746e3606a84 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:55.718053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb450fd-abea-4cca-94fb-0746e3606a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:55.718330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb450fd-abea-4cca-94fb-0746e3606a84 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:55.719214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb450fd-abea-4cca-94fb-0746e3606a84 admin admin] RBAC: Adding query filter params (role.id=92a6afea4f7e4005a5802785c009f5d3, scope.project.id=7ec70d8afc7144bd9fc12156d01e6855, user.id=15975bd016ed48f9bf5c88845180ebf0) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:55.719529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb450fd-abea-4cca-94fb-0746e3606a84 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:55.721755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb450fd-abea-4cca-94fb-0746e3606a84 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:55.727528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 638/1285] 10.222.0.117 () {56 vars in 1400 bytes} [Mon Jan 24 16:40:55 2022] GET /identity/v3/role_assignments?user.id=15975bd016ed48f9bf5c88845180ebf0&scope.project.id=7ec70d8afc7144bd9fc12156d01e6855&role.id=92a6afea4f7e4005a5802785c009f5d3 => generated 610 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:57.926983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973dd41-5031-4ad5-9eb5-61e7c575daa7 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:57.927537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973dd41-5031-4ad5-9eb5-61e7c575daa7 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:57.927537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973dd41-5031-4ad5-9eb5-61e7c575daa7 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:57.930129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 648/1286] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:40:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:40:57.934943 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c271bc-f65e-46c4-a6e0-b67e20595c46 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:57.935343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c271bc-f65e-46c4-a6e0-b67e20595c46 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:57.935492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c271bc-f65e-46c4-a6e0-b67e20595c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:57.954028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-30c271bc-f65e-46c4-a6e0-b67e20595c46 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:40:57.955255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-30c271bc-f65e-46c4-a6e0-b67e20595c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:40:57.963025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 639/1287] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:40:57 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:40:57.986066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973dd41-5031-4ad5-9eb5-61e7c575daa7 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:57.998803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973dd41-5031-4ad5-9eb5-61e7c575daa7 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:58.003401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381a3b9-9fa3-478e-878a-2ad9b384264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:58.004158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381a3b9-9fa3-478e-878a-2ad9b384264e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:58.004437 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381a3b9-9fa3-478e-878a-2ad9b384264e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:58.004707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381a3b9-9fa3-478e-878a-2ad9b384264e admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:58.005358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381a3b9-9fa3-478e-878a-2ad9b384264e admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:58.006955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381a3b9-9fa3-478e-878a-2ad9b384264e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:58.018547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-3381a3b9-9fa3-478e-878a-2ad9b384264e admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 24 16:40:58.019684 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 649/1288] 10.222.0.117 () {56 vars in 1143 bytes} [Mon Jan 24 16:40:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:40:58.025284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c271bc-f65e-46c4-a6e0-b67e20595c46 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:58.034006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c271bc-f65e-46c4-a6e0-b67e20595c46 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:58.038445 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892398-664b-4b8c-ba65-d6761991f098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:58.039117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892398-664b-4b8c-ba65-d6761991f098 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:58.039401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892398-664b-4b8c-ba65-d6761991f098 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:58.039678 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892398-664b-4b8c-ba65-d6761991f098 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:58.040395 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892398-664b-4b8c-ba65-d6761991f098 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:58.040702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892398-664b-4b8c-ba65-d6761991f098 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:58.042445 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892398-664b-4b8c-ba65-d6761991f098 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:58.047112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 640/1289] 10.222.0.117 () {56 vars in 1142 bytes} [Mon Jan 24 16:40:58 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:40:58.052230 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381a3b9-9fa3-478e-878a-2ad9b384264e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:40:58.061969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381a3b9-9fa3-478e-878a-2ad9b384264e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:40:58.066434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f58dcc-7da7-4efe-818b-bbd87a417502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:40:58.067084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f58dcc-7da7-4efe-818b-bbd87a417502 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:40:58.067372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f58dcc-7da7-4efe-818b-bbd87a417502 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:40:58.067651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f58dcc-7da7-4efe-818b-bbd87a417502 admin admin] PATH_INFO: `/v3/services` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:40:58.068355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f58dcc-7da7-4efe-818b-bbd87a417502 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:40:58.068660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f58dcc-7da7-4efe-818b-bbd87a417502 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:40:58.070196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f58dcc-7da7-4efe-818b-bbd87a417502 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:40:58.075220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 650/1290] 10.222.0.117 () {56 vars in 1142 bytes} [Mon Jan 24 16:40:58 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:41:00.312134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec36c01-b7ef-47b6-aa19-491401a3bea2 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:00.312672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec36c01-b7ef-47b6-aa19-491401a3bea2 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:00.312672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec36c01-b7ef-47b6-aa19-491401a3bea2 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:00.314442 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 641/1291] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:41:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:41:00.319778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56187a0-7ca0-4f72-a724-aa7b052f00ca None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:00.320206 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56187a0-7ca0-4f72-a724-aa7b052f00ca None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:00.320325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56187a0-7ca0-4f72-a724-aa7b052f00ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:00.338414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b56187a0-7ca0-4f72-a724-aa7b052f00ca None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:41:00.339612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b56187a0-7ca0-4f72-a724-aa7b052f00ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:41:00.347372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 651/1292] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:41:00 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:41:00.371041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec36c01-b7ef-47b6-aa19-491401a3bea2 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:41:00.383866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec36c01-b7ef-47b6-aa19-491401a3bea2 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:41:00.390045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cb9d5-7806-4c5a-9594-4420d48cd4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:41:00.390726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cb9d5-7806-4c5a-9594-4420d48cd4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:00.391059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cb9d5-7806-4c5a-9594-4420d48cd4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:00.391417 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cb9d5-7806-4c5a-9594-4420d48cd4c4 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:00.392292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cb9d5-7806-4c5a-9594-4420d48cd4c4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:41:00.394132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cb9d5-7806-4c5a-9594-4420d48cd4c4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:41:00.408847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 642/1293] 10.222.0.117 () {60 vars in 1167 bytes} [Mon Jan 24 16:41:00 2022] POST /identity/v3/services => generated 247 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:41:02.606772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9124b3-cefc-48c3-964c-4945800b7e33 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:02.607352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9124b3-cefc-48c3-964c-4945800b7e33 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:02.607352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9124b3-cefc-48c3-964c-4945800b7e33 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:02.609213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 652/1294] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:41:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:41:02.614341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb580c-7a39-46c4-a0a4-b5f3c7cfc976 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:02.614791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb580c-7a39-46c4-a0a4-b5f3c7cfc976 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:02.614899 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb580c-7a39-46c4-a0a4-b5f3c7cfc976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:02.632399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-72fb580c-7a39-46c4-a0a4-b5f3c7cfc976 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:41:02.633565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-72fb580c-7a39-46c4-a0a4-b5f3c7cfc976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:41:02.650519 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 643/1295] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:41:02 2022] POST /identity/v3/auth/tokens => generated 3085 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:41:02.674228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9124b3-cefc-48c3-964c-4945800b7e33 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:41:02.687174 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9124b3-cefc-48c3-964c-4945800b7e33 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:41:02.691516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fd662-9aa9-406f-b41d-fa35c6be2f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:41:02.692280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fd662-9aa9-406f-b41d-fa35c6be2f3e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:02.692561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fd662-9aa9-406f-b41d-fa35c6be2f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:02.692834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fd662-9aa9-406f-b41d-fa35c6be2f3e admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:02.693493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fd662-9aa9-406f-b41d-fa35c6be2f3e admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:41:02.695106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fd662-9aa9-406f-b41d-fa35c6be2f3e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:41:02.706619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-fe7fd662-9aa9-406f-b41d-fa35c6be2f3e admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 24 16:41:02.707739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 653/1296] 10.222.0.117 () {56 vars in 1143 bytes} [Mon Jan 24 16:41:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:41:02.713500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb580c-7a39-46c4-a0a4-b5f3c7cfc976 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:41:02.722374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb580c-7a39-46c4-a0a4-b5f3c7cfc976 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:41:02.726769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8104ebc-b6ef-453a-9e8d-511959af5724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:41:02.727424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8104ebc-b6ef-453a-9e8d-511959af5724 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:02.728198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8104ebc-b6ef-453a-9e8d-511959af5724 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:02.728471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8104ebc-b6ef-453a-9e8d-511959af5724 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:02.729182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8104ebc-b6ef-453a-9e8d-511959af5724 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:41:02.729475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8104ebc-b6ef-453a-9e8d-511959af5724 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:41:02.731067 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8104ebc-b6ef-453a-9e8d-511959af5724 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:41:02.735961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 644/1297] 10.222.0.117 () {56 vars in 1142 bytes} [Mon Jan 24 16:41:02 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:41:02.741279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fd662-9aa9-406f-b41d-fa35c6be2f3e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:41:02.752324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fd662-9aa9-406f-b41d-fa35c6be2f3e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:41:02.756952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fef31-cca0-4d2a-937f-5f597acf258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:41:02.757834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fef31-cca0-4d2a-937f-5f597acf258c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:02.758118 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fef31-cca0-4d2a-937f-5f597acf258c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:02.758397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fef31-cca0-4d2a-937f-5f597acf258c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:02.759234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fef31-cca0-4d2a-937f-5f597acf258c admin admin] RBAC: Adding query filter params (interface=public, service_id=38c9e701e19540c4a1405302edb69c3b, region_id=RegionOne) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:41:02.759544 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fef31-cca0-4d2a-937f-5f597acf258c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:41:02.761095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fef31-cca0-4d2a-937f-5f597acf258c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:41:02.765974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 654/1298] 10.222.0.117 () {56 vars in 1277 bytes} [Mon Jan 24 16:41:02 2022] GET /identity/v3/endpoints?service_id=38c9e701e19540c4a1405302edb69c3b&interface=public®ion_id=RegionOne => generated 195 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:41:02.771185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8104ebc-b6ef-453a-9e8d-511959af5724 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:41:02.780863 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8104ebc-b6ef-453a-9e8d-511959af5724 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:41:02.785361 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec67f56-103b-4284-8834-4c8c91786d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:41:02.785995 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec67f56-103b-4284-8834-4c8c91786d13 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:02.786279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec67f56-103b-4284-8834-4c8c91786d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:02.786555 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec67f56-103b-4284-8834-4c8c91786d13 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:02.787421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec67f56-103b-4284-8834-4c8c91786d13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:41:02.788983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec67f56-103b-4284-8834-4c8c91786d13 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:41:02.796387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 645/1299] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:41:02 2022] GET /identity/v3/services => generated 2201 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:41:04.996856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9456-d5d9-4a1a-892d-c418c939d925 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:04.997390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9456-d5d9-4a1a-892d-c418c939d925 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:04.997390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9456-d5d9-4a1a-892d-c418c939d925 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:04.999226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 655/1300] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:41:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:41:05.006952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70449-1ca2-4e5c-b8f4-12a2da6ebf83 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:05.007437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70449-1ca2-4e5c-b8f4-12a2da6ebf83 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:05.007534 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70449-1ca2-4e5c-b8f4-12a2da6ebf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:05.025941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e3e70449-1ca2-4e5c-b8f4-12a2da6ebf83 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:41:05.027160 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e3e70449-1ca2-4e5c-b8f4-12a2da6ebf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:41:05.034714 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 646/1301] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:41:05 2022] POST /identity/v3/auth/tokens => generated 3085 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:41:05.058148 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c9456-d5d9-4a1a-892d-c418c939d925 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:41:05.070149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c9456-d5d9-4a1a-892d-c418c939d925 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:41:05.075221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf25b8-010d-4fd7-b78d-c6bb02b752d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:41:05.075984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf25b8-010d-4fd7-b78d-c6bb02b752d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:05.076267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf25b8-010d-4fd7-b78d-c6bb02b752d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:05.076540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf25b8-010d-4fd7-b78d-c6bb02b752d2 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:05.077195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf25b8-010d-4fd7-b78d-c6bb02b752d2 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:41:05.078777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf25b8-010d-4fd7-b78d-c6bb02b752d2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:41:05.090802 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING keystone.server.flask.application [None req-a3bf25b8-010d-4fd7-b78d-c6bb02b752d2 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 24 16:41:05.091912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 656/1302] 10.222.0.117 () {56 vars in 1143 bytes} [Mon Jan 24 16:41:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 24 16:41:05.097844 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e70449-1ca2-4e5c-b8f4-12a2da6ebf83 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:41:05.106661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e70449-1ca2-4e5c-b8f4-12a2da6ebf83 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:41:05.111180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641c16e-571d-4b12-8a05-8b16b038ef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:41:05.111816 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641c16e-571d-4b12-8a05-8b16b038ef54 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:05.112099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641c16e-571d-4b12-8a05-8b16b038ef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:05.112376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641c16e-571d-4b12-8a05-8b16b038ef54 admin admin] PATH_INFO: `/v3/services` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:05.113091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641c16e-571d-4b12-8a05-8b16b038ef54 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:41:05.113396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641c16e-571d-4b12-8a05-8b16b038ef54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:41:05.115018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641c16e-571d-4b12-8a05-8b16b038ef54 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:41:05.120081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 647/1303] 10.222.0.117 () {56 vars in 1142 bytes} [Mon Jan 24 16:41:05 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:41:05.125532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf25b8-010d-4fd7-b78d-c6bb02b752d2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:41:05.136090 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf25b8-010d-4fd7-b78d-c6bb02b752d2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:41:05.140611 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0373c-3dd5-4a67-a4eb-22c3430e2f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:41:05.141239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0373c-3dd5-4a67-a4eb-22c3430e2f67 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:41:05.141524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0373c-3dd5-4a67-a4eb-22c3430e2f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:41:05.141800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0373c-3dd5-4a67-a4eb-22c3430e2f67 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:41:05.142543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0373c-3dd5-4a67-a4eb-22c3430e2f67 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:41:05.144230 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0373c-3dd5-4a67-a4eb-22c3430e2f67 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:41:05.164099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 657/1304] 10.222.0.117 () {60 vars in 1170 bytes} [Mon Jan 24 16:41:05 2022] POST /identity/v3/endpoints => generated 333 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:42:08.549417 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae419bba-0b3d-43d2-90ee-96ee7e1fad0f None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:08.550571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae419bba-0b3d-43d2-90ee-96ee7e1fad0f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:08.551090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae419bba-0b3d-43d2-90ee-96ee7e1fad0f None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:08.554067 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 648/1305] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:08 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:08.559382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2e75-940c-4b91-acc3-01ced292d6e1 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:08.560228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2e75-940c-4b91-acc3-01ced292d6e1 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:08.560704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2e75-940c-4b91-acc3-01ced292d6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:08.698780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b80c2e75-940c-4b91-acc3-01ced292d6e1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:08.700134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b80c2e75-940c-4b91-acc3-01ced292d6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:08.846891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 658/1306] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:08.870303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae419bba-0b3d-43d2-90ee-96ee7e1fad0f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:08.872169 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ae419bba-0b3d-43d2-90ee-96ee7e1fad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:09.026279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae419bba-0b3d-43d2-90ee-96ee7e1fad0f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:09.128556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e2e79-386f-41d9-b352-31c100ac2853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:09.129106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2e79-386f-41d9-b352-31c100ac2853 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:09.129381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2e79-386f-41d9-b352-31c100ac2853 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:09.129648 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2e79-386f-41d9-b352-31c100ac2853 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:09.131198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e2e79-386f-41d9-b352-31c100ac2853 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:09.135656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e2e79-386f-41d9-b352-31c100ac2853 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:09.159363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 649/1307] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:42:08 2022] GET /identity/v3/projects => generated 2562 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:42:11.429580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1671-d78a-4c3e-9d8a-2fa95f66e41d None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:11.430070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1671-d78a-4c3e-9d8a-2fa95f66e41d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:11.430070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1671-d78a-4c3e-9d8a-2fa95f66e41d None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:11.431870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 659/1308] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:11.437044 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5d81-e061-4a61-aaa6-33f56aafe838 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:11.437462 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5d81-e061-4a61-aaa6-33f56aafe838 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:11.437602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5d81-e061-4a61-aaa6-33f56aafe838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:11.507904 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-579f5d81-e061-4a61-aaa6-33f56aafe838 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:11.509108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-579f5d81-e061-4a61-aaa6-33f56aafe838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:11.607311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 650/1309] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:11.631675 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec1671-d78a-4c3e-9d8a-2fa95f66e41d None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:11.633293 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1aec1671-d78a-4c3e-9d8a-2fa95f66e41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:11.777325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec1671-d78a-4c3e-9d8a-2fa95f66e41d None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:11.885025 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7203e1-f8f1-4557-8bb1-d4db8c9bac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:11.885689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7203e1-f8f1-4557-8bb1-d4db8c9bac4d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:11.885966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7203e1-f8f1-4557-8bb1-d4db8c9bac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:11.886243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7203e1-f8f1-4557-8bb1-d4db8c9bac4d admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:11.887032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7203e1-f8f1-4557-8bb1-d4db8c9bac4d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:11.888887 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7203e1-f8f1-4557-8bb1-d4db8c9bac4d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:11.912015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 660/1310] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:42:11 2022] GET /identity/v3/projects => generated 2562 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:42:14.188598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10053b3c-2b10-4d88-a0af-aa3cf09af6e5 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:14.189100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10053b3c-2b10-4d88-a0af-aa3cf09af6e5 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:14.189193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10053b3c-2b10-4d88-a0af-aa3cf09af6e5 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:14.191197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 651/1311] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:14.196340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544dcd1-2918-41e6-a149-01a697c26610 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:14.196758 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544dcd1-2918-41e6-a149-01a697c26610 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:14.196940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544dcd1-2918-41e6-a149-01a697c26610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:14.260580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-3544dcd1-2918-41e6-a149-01a697c26610 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:14.261668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3544dcd1-2918-41e6-a149-01a697c26610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:14.362280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 661/1312] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:42:14.413454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50770071-2d95-4cbc-af4d-fb67d74ebefa None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:14.413737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50770071-2d95-4cbc-af4d-fb67d74ebefa None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:14.414016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50770071-2d95-4cbc-af4d-fb67d74ebefa None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:14.415827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 652/1313] 10.222.0.117 () {54 vars in 969 bytes} [Mon Jan 24 16:42:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:14.421559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c0f2b-fc63-4dae-97fa-02755e2e392a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:14.421844 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c0f2b-fc63-4dae-97fa-02755e2e392a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:14.422197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c0f2b-fc63-4dae-97fa-02755e2e392a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:14.493289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5c4c0f2b-fc63-4dae-97fa-02755e2e392a None None] MFA Rules not processed for user `aa9834b75e2b4ac787f3917564090d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:14.494485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5c4c0f2b-fc63-4dae-97fa-02755e2e392a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:14.566214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 662/1314] 10.222.0.117 () {58 vars in 1066 bytes} [Mon Jan 24 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:14.575873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50770071-2d95-4cbc-af4d-fb67d74ebefa None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:14.577389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-50770071-2d95-4cbc-af4d-fb67d74ebefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:14.674934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50770071-2d95-4cbc-af4d-fb67d74ebefa None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:14.747118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6637ce-0e8b-4283-9c97-3111cf7237c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:14.747759 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6637ce-0e8b-4283-9c97-3111cf7237c1 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:14.748043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6637ce-0e8b-4283-9c97-3111cf7237c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:14.748316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6637ce-0e8b-4283-9c97-3111cf7237c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:14.749944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9a6637ce-0e8b-4283-9c97-3111cf7237c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:14.860737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6637ce-0e8b-4283-9c97-3111cf7237c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:14.862112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6637ce-0e8b-4283-9c97-3111cf7237c1 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:14.880711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 653/1315] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:17.422156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0149017-8410-4fa2-975e-c70b31f7f247 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:17.422671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0149017-8410-4fa2-975e-c70b31f7f247 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:17.422671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0149017-8410-4fa2-975e-c70b31f7f247 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:17.424440 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 663/1316] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:17.430109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baaf34-4df7-4b11-9157-12b93134f52d None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:17.430505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baaf34-4df7-4b11-9157-12b93134f52d None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:17.430654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baaf34-4df7-4b11-9157-12b93134f52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:17.494410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-42baaf34-4df7-4b11-9157-12b93134f52d None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:17.495626 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-42baaf34-4df7-4b11-9157-12b93134f52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:17.595950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 654/1317] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:17.630233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0149017-8410-4fa2-975e-c70b31f7f247 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:17.631782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d0149017-8410-4fa2-975e-c70b31f7f247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:17.757217 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0149017-8410-4fa2-975e-c70b31f7f247 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:17.860568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f03389-48c0-4c1b-92d2-3e4c46ed3141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:17.861418 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f03389-48c0-4c1b-92d2-3e4c46ed3141 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:17.861698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f03389-48c0-4c1b-92d2-3e4c46ed3141 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:17.861971 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f03389-48c0-4c1b-92d2-3e4c46ed3141 admin admin] PATH_INFO: `/v3/projects/6e0f1fba09874be8ae22b37e033b5e57` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:17.862919 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f03389-48c0-4c1b-92d2-3e4c46ed3141 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e0f1fba09874be8ae22b37e033b5e57)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:17.865451 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f03389-48c0-4c1b-92d2-3e4c46ed3141 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:17.867160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 664/1318] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:42:17 2022] GET /identity/v3/projects/6e0f1fba09874be8ae22b37e033b5e57 => generated 345 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:42:17.878806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baaf34-4df7-4b11-9157-12b93134f52d None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:17.880732 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-42baaf34-4df7-4b11-9157-12b93134f52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:17.967790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baaf34-4df7-4b11-9157-12b93134f52d None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:18.037563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452c969-41dc-4dab-b2c0-c5d317b3fd7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:18.038200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452c969-41dc-4dab-b2c0-c5d317b3fd7a service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:18.038480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452c969-41dc-4dab-b2c0-c5d317b3fd7a service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:18.038774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452c969-41dc-4dab-b2c0-c5d317b3fd7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:18.040390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7452c969-41dc-4dab-b2c0-c5d317b3fd7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:18.144596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452c969-41dc-4dab-b2c0-c5d317b3fd7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:18.146103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452c969-41dc-4dab-b2c0-c5d317b3fd7a service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:18.166474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 655/1319] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:20.689732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54c59-8459-4650-a05a-f4fff1d83f5a None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:20.690270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54c59-8459-4650-a05a-f4fff1d83f5a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:20.690270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54c59-8459-4650-a05a-f4fff1d83f5a None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:20.692715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 665/1320] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:20.697875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a60a31-3f32-41c8-bd79-527c753c4b92 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:20.698286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a60a31-3f32-41c8-bd79-527c753c4b92 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:20.698401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a60a31-3f32-41c8-bd79-527c753c4b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:20.760374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-98a60a31-3f32-41c8-bd79-527c753c4b92 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:20.761547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-98a60a31-3f32-41c8-bd79-527c753c4b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:20.851856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 656/1321] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:20.886863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54c59-8459-4650-a05a-f4fff1d83f5a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:20.888381 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c4c54c59-8459-4650-a05a-f4fff1d83f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:21.010318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54c59-8459-4650-a05a-f4fff1d83f5a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:21.100228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede8bbd-a4b5-4fae-a641-8226d536ae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:21.101075 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8bbd-a4b5-4fae-a641-8226d536ae29 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:21.101365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8bbd-a4b5-4fae-a641-8226d536ae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:21.101636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8bbd-a4b5-4fae-a641-8226d536ae29 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:21.111165 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede8bbd-a4b5-4fae-a641-8226d536ae29 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:21.113202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede8bbd-a4b5-4fae-a641-8226d536ae29 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:21.115487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 666/1322] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:42:20 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:42:21.127100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a60a31-3f32-41c8-bd79-527c753c4b92 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:21.128335 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-98a60a31-3f32-41c8-bd79-527c753c4b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:21.218298 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a60a31-3f32-41c8-bd79-527c753c4b92 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:21.288298 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6e58e-a4dc-4475-8396-bdaccf3f07bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:21.288935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e58e-a4dc-4475-8396-bdaccf3f07bf service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:21.289215 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e58e-a4dc-4475-8396-bdaccf3f07bf service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:21.289487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e58e-a4dc-4475-8396-bdaccf3f07bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:21.291157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-73c6e58e-a4dc-4475-8396-bdaccf3f07bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:21.398640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6e58e-a4dc-4475-8396-bdaccf3f07bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:21.400079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6e58e-a4dc-4475-8396-bdaccf3f07bf service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:21.417389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 657/1323] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:24.143362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9c55e-2207-4a3f-ada8-d41871d48f8b None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:24.143901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9c55e-2207-4a3f-ada8-d41871d48f8b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:24.143901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9c55e-2207-4a3f-ada8-d41871d48f8b None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:24.145856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 667/1324] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:24.151146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a172e-0f07-4aaf-8c9b-d04a9901bac0 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:24.151574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a172e-0f07-4aaf-8c9b-d04a9901bac0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:24.151703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a172e-0f07-4aaf-8c9b-d04a9901bac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:24.214349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-df9a172e-0f07-4aaf-8c9b-d04a9901bac0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:24.215828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-df9a172e-0f07-4aaf-8c9b-d04a9901bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:24.308429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 658/1325] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:42:24.343832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9c55e-2207-4a3f-ada8-d41871d48f8b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:24.345515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-81d9c55e-2207-4a3f-ada8-d41871d48f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:24.469157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9c55e-2207-4a3f-ada8-d41871d48f8b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:24.557524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323753e6-cc59-40ea-8cc3-46f8e335be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:24.558359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323753e6-cc59-40ea-8cc3-46f8e335be15 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:24.558636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323753e6-cc59-40ea-8cc3-46f8e335be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:24.558939 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323753e6-cc59-40ea-8cc3-46f8e335be15 admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:24.568801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323753e6-cc59-40ea-8cc3-46f8e335be15 admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:24.570865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323753e6-cc59-40ea-8cc3-46f8e335be15 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:24.572517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 668/1326] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:42:24 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:42:24.584757 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a172e-0f07-4aaf-8c9b-d04a9901bac0 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:24.585969 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-df9a172e-0f07-4aaf-8c9b-d04a9901bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:24.679567 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a172e-0f07-4aaf-8c9b-d04a9901bac0 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:24.759302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e237ec-211b-4386-b737-aa138c918744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:24.759857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e237ec-211b-4386-b737-aa138c918744 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:24.760138 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e237ec-211b-4386-b737-aa138c918744 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:24.760412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e237ec-211b-4386-b737-aa138c918744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:24.762036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-48e237ec-211b-4386-b737-aa138c918744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:24.866630 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e237ec-211b-4386-b737-aa138c918744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:24.868082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e237ec-211b-4386-b737-aa138c918744 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:24.885728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 659/1327] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:27.760590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e19bc-5908-48a1-835e-401b6a7aa0f3 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:27.761185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e19bc-5908-48a1-835e-401b6a7aa0f3 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:27.761185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e19bc-5908-48a1-835e-401b6a7aa0f3 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:27.763008 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 669/1328] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:27.768272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d2294-7243-4f6b-8500-8d9f5727e522 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:27.768672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d2294-7243-4f6b-8500-8d9f5727e522 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:27.768814 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d2294-7243-4f6b-8500-8d9f5727e522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:27.833050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-8f2d2294-7243-4f6b-8500-8d9f5727e522 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:27.834253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8f2d2294-7243-4f6b-8500-8d9f5727e522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:27.928394 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 660/1329] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:27.964609 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e19bc-5908-48a1-835e-401b6a7aa0f3 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:27.966385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1c1e19bc-5908-48a1-835e-401b6a7aa0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:28.067187 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e19bc-5908-48a1-835e-401b6a7aa0f3 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:28.138385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fe8ad-4d42-4741-a466-fd98b8b0711c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:28.139088 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fe8ad-4d42-4741-a466-fd98b8b0711c service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:28.139362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fe8ad-4d42-4741-a466-fd98b8b0711c service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:28.139628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fe8ad-4d42-4741-a466-fd98b8b0711c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:28.141291 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2e4fe8ad-4d42-4741-a466-fd98b8b0711c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:28.249262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fe8ad-4d42-4741-a466-fd98b8b0711c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:28.250686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fe8ad-4d42-4741-a466-fd98b8b0711c service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:28.268377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 670/1330] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:30.554729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119e341-f476-4fd4-9b58-e5e17c5081fe None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:30.555303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119e341-f476-4fd4-9b58-e5e17c5081fe None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:30.555303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119e341-f476-4fd4-9b58-e5e17c5081fe None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:30.557103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 661/1331] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:30.562515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918cfd-ecd4-4697-95a0-e9514c52a97d None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:30.562955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918cfd-ecd4-4697-95a0-e9514c52a97d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:30.563096 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918cfd-ecd4-4697-95a0-e9514c52a97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:30.627810 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-da918cfd-ecd4-4697-95a0-e9514c52a97d None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:30.629346 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-da918cfd-ecd4-4697-95a0-e9514c52a97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:30.727951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 671/1332] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:30.764575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119e341-f476-4fd4-9b58-e5e17c5081fe None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:30.766074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e119e341-f476-4fd4-9b58-e5e17c5081fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:30.865761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119e341-f476-4fd4-9b58-e5e17c5081fe None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:30.934790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f82985-0643-4cd4-9228-23cbd959a742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:30.935436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f82985-0643-4cd4-9228-23cbd959a742 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:30.935719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f82985-0643-4cd4-9228-23cbd959a742 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:30.935996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f82985-0643-4cd4-9228-23cbd959a742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:30.937615 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-12f82985-0643-4cd4-9228-23cbd959a742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:31.045124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f82985-0643-4cd4-9228-23cbd959a742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:31.046575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f82985-0643-4cd4-9228-23cbd959a742 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:31.064343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 662/1333] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:33.343694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85215-7dd9-491a-81af-18b4d20a727a None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:33.344242 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85215-7dd9-491a-81af-18b4d20a727a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:33.344331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85215-7dd9-491a-81af-18b4d20a727a None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:33.346060 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 672/1334] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:33.352277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38860781-9646-4480-a908-5ba2572c5d17 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:33.352721 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38860781-9646-4480-a908-5ba2572c5d17 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:33.352832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38860781-9646-4480-a908-5ba2572c5d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:33.416563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-38860781-9646-4480-a908-5ba2572c5d17 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:33.417658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-38860781-9646-4480-a908-5ba2572c5d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:33.511135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 663/1335] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:33.544077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f85215-7dd9-491a-81af-18b4d20a727a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:33.545590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-51f85215-7dd9-491a-81af-18b4d20a727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:33.669070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f85215-7dd9-491a-81af-18b4d20a727a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:33.761517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343359a0-cf77-49c7-aba6-cea185e6452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:33.762370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343359a0-cf77-49c7-aba6-cea185e6452c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:33.762650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343359a0-cf77-49c7-aba6-cea185e6452c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:33.762954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343359a0-cf77-49c7-aba6-cea185e6452c admin admin] PATH_INFO: `/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:33.772741 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343359a0-cf77-49c7-aba6-cea185e6452c admin admin] RBAC: Authorizing `identity:get_project(project_id=3035a30a67154f908dd0a8d0bd3d5b2b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:33.774840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343359a0-cf77-49c7-aba6-cea185e6452c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:33.781777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 673/1336] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:42:33 2022] GET /identity/v3/projects/3035a30a67154f908dd0a8d0bd3d5b2b => generated 299 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:42:33.788564 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38860781-9646-4480-a908-5ba2572c5d17 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:33.789791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-38860781-9646-4480-a908-5ba2572c5d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:33.876629 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38860781-9646-4480-a908-5ba2572c5d17 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:33.947697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a599ba-bcb7-4767-97ef-b1c1640fbf57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:33.948267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a599ba-bcb7-4767-97ef-b1c1640fbf57 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:33.948553 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a599ba-bcb7-4767-97ef-b1c1640fbf57 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:33.948832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a599ba-bcb7-4767-97ef-b1c1640fbf57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:33.950498 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c1a599ba-bcb7-4767-97ef-b1c1640fbf57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:34.058609 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a599ba-bcb7-4767-97ef-b1c1640fbf57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:34.060082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a599ba-bcb7-4767-97ef-b1c1640fbf57 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:34.077474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 664/1337] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:36.538190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412bd2a-34b7-4a60-a0ff-96d9484d238c None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:36.538702 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412bd2a-34b7-4a60-a0ff-96d9484d238c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:36.538941 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412bd2a-34b7-4a60-a0ff-96d9484d238c None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:36.540807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 674/1338] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:36.546088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede94e1-feaa-4ee5-8e37-70f700ada15a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:36.546554 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede94e1-feaa-4ee5-8e37-70f700ada15a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:36.546635 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede94e1-feaa-4ee5-8e37-70f700ada15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:36.613222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7ede94e1-feaa-4ee5-8e37-70f700ada15a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:36.614385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7ede94e1-feaa-4ee5-8e37-70f700ada15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:36.713792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 665/1339] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:36.766217 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0972d-2d40-4710-9623-0c71050a39f9 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:36.766532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0972d-2d40-4710-9623-0c71050a39f9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:36.766843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0972d-2d40-4710-9623-0c71050a39f9 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:36.769285 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 675/1340] 10.222.0.117 () {54 vars in 969 bytes} [Mon Jan 24 16:42:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:36.775867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1f54d-279a-40ce-be87-0d37f4c1f54f None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:36.776210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1f54d-279a-40ce-be87-0d37f4c1f54f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:36.776494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1f54d-279a-40ce-be87-0d37f4c1f54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:36.856537 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-64b1f54d-279a-40ce-be87-0d37f4c1f54f None None] MFA Rules not processed for user `aa9834b75e2b4ac787f3917564090d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:36.857847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-64b1f54d-279a-40ce-be87-0d37f4c1f54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:36.934435 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 666/1341] 10.222.0.117 () {58 vars in 1066 bytes} [Mon Jan 24 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:36.944046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0972d-2d40-4710-9623-0c71050a39f9 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:36.945789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-19a0972d-2d40-4710-9623-0c71050a39f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:37.053067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0972d-2d40-4710-9623-0c71050a39f9 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:37.125556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a141bd3-38eb-4d8e-bbf2-e4fd59b7ecbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:37.126123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a141bd3-38eb-4d8e-bbf2-e4fd59b7ecbf service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:37.126406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a141bd3-38eb-4d8e-bbf2-e4fd59b7ecbf service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:37.126715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a141bd3-38eb-4d8e-bbf2-e4fd59b7ecbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:37.129269 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7a141bd3-38eb-4d8e-bbf2-e4fd59b7ecbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:37.238841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a141bd3-38eb-4d8e-bbf2-e4fd59b7ecbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:37.240272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a141bd3-38eb-4d8e-bbf2-e4fd59b7ecbf service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:37.259022 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 676/1342] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:39.784897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626cf0b-4754-431a-8553-661f795d255f None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:39.785429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626cf0b-4754-431a-8553-661f795d255f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:39.785554 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626cf0b-4754-431a-8553-661f795d255f None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:39.787423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 667/1343] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:39.792529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25b30-9f8e-4139-8f7b-124b23d988df None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:39.792920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25b30-9f8e-4139-8f7b-124b23d988df None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:39.793077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25b30-9f8e-4139-8f7b-124b23d988df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:39.865543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-34f25b30-9f8e-4139-8f7b-124b23d988df None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:39.866745 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-34f25b30-9f8e-4139-8f7b-124b23d988df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:39.970738 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 677/1344] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:40.006422 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626cf0b-4754-431a-8553-661f795d255f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:40.019511 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626cf0b-4754-431a-8553-661f795d255f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:40.023929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae455f-6ae4-49d9-8e09-1af856f3dd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:40.024762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae455f-6ae4-49d9-8e09-1af856f3dd54 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:40.025072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae455f-6ae4-49d9-8e09-1af856f3dd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:40.025350 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae455f-6ae4-49d9-8e09-1af856f3dd54 admin admin] PATH_INFO: `/v3/projects/6e0f1fba09874be8ae22b37e033b5e57` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:40.026554 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae455f-6ae4-49d9-8e09-1af856f3dd54 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e0f1fba09874be8ae22b37e033b5e57)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:40.028382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae455f-6ae4-49d9-8e09-1af856f3dd54 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:40.030040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 668/1345] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:42:40 2022] GET /identity/v3/projects/6e0f1fba09874be8ae22b37e033b5e57 => generated 345 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:42:40.041180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f25b30-9f8e-4139-8f7b-124b23d988df None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:40.042564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-34f25b30-9f8e-4139-8f7b-124b23d988df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:40.135809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f25b30-9f8e-4139-8f7b-124b23d988df None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:40.139495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aecba-ad40-468e-a743-ccf57cdb19cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:40.140130 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aecba-ad40-468e-a743-ccf57cdb19cb service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:40.140412 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aecba-ad40-468e-a743-ccf57cdb19cb service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:40.140685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aecba-ad40-468e-a743-ccf57cdb19cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:40.150013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2aecba-ad40-468e-a743-ccf57cdb19cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:40.151503 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2aecba-ad40-468e-a743-ccf57cdb19cb service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:40.161811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 678/1346] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:42.664642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d0751-3338-4ee2-b327-6f09d97c5435 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:42.665200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d0751-3338-4ee2-b327-6f09d97c5435 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:42.665200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d0751-3338-4ee2-b327-6f09d97c5435 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:42.666985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 669/1347] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:42.672061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba88c2-6851-4d4d-94b1-31d4bf2bde1a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:42.672460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba88c2-6851-4d4d-94b1-31d4bf2bde1a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:42.672622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba88c2-6851-4d4d-94b1-31d4bf2bde1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:42.692294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-acba88c2-6851-4d4d-94b1-31d4bf2bde1a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:42.693484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-acba88c2-6851-4d4d-94b1-31d4bf2bde1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:42.701294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 679/1348] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:42.738058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d0751-3338-4ee2-b327-6f09d97c5435 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:42.739808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-732d0751-3338-4ee2-b327-6f09d97c5435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:42.752560 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d0751-3338-4ee2-b327-6f09d97c5435 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:42.756189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b83de-d298-42fc-89fc-282aa234cc4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:42.756839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b83de-d298-42fc-89fc-282aa234cc4d service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:42.757977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b83de-d298-42fc-89fc-282aa234cc4d service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:42.758288 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b83de-d298-42fc-89fc-282aa234cc4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:42.767045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b83de-d298-42fc-89fc-282aa234cc4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:42.768734 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b83de-d298-42fc-89fc-282aa234cc4d service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:42.777950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 670/1349] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:47.263372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4950a58-c982-4a6b-a95a-53bb6bd14759 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:47.263909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4950a58-c982-4a6b-a95a-53bb6bd14759 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:47.263909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4950a58-c982-4a6b-a95a-53bb6bd14759 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:47.265658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 680/1350] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:47.271126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a5614-6eb5-4660-a4d2-afaa5520d052 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:47.271528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a5614-6eb5-4660-a4d2-afaa5520d052 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:47.271685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a5614-6eb5-4660-a4d2-afaa5520d052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:47.290087 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-f75a5614-6eb5-4660-a4d2-afaa5520d052 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:47.291312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f75a5614-6eb5-4660-a4d2-afaa5520d052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:47.299756 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 671/1351] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:47.322983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4950a58-c982-4a6b-a95a-53bb6bd14759 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:47.335423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4950a58-c982-4a6b-a95a-53bb6bd14759 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:47.340034 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf97e6c-9878-4d9b-a4dd-b6d9e7181cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:47.340663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97e6c-9878-4d9b-a4dd-b6d9e7181cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:47.340938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97e6c-9878-4d9b-a4dd-b6d9e7181cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:47.341202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97e6c-9878-4d9b-a4dd-b6d9e7181cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:47.342101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf97e6c-9878-4d9b-a4dd-b6d9e7181cd6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:47.344103 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf97e6c-9878-4d9b-a4dd-b6d9e7181cd6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:47.357851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 681/1352] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:42:47 2022] GET /identity/v3/projects => generated 2562 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:42:49.614444 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ec399-c87e-42ea-881d-566503def14c None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:49.615000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ec399-c87e-42ea-881d-566503def14c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:49.615087 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ec399-c87e-42ea-881d-566503def14c None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:49.616808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 672/1353] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:49.622208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605143c8-d514-4da9-92bd-0a259d9a66c2 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:49.622666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605143c8-d514-4da9-92bd-0a259d9a66c2 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:49.622904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605143c8-d514-4da9-92bd-0a259d9a66c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:49.641886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-605143c8-d514-4da9-92bd-0a259d9a66c2 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:49.643196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-605143c8-d514-4da9-92bd-0a259d9a66c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:49.651273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 682/1354] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:49.685775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ec399-c87e-42ea-881d-566503def14c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:49.698951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ec399-c87e-42ea-881d-566503def14c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:49.703359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a98b77-9df0-4e2d-9cf0-e089014427d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:49.704195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a98b77-9df0-4e2d-9cf0-e089014427d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:49.704479 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a98b77-9df0-4e2d-9cf0-e089014427d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:49.704870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a98b77-9df0-4e2d-9cf0-e089014427d6 admin admin] PATH_INFO: `/v3/projects/6e0f1fba09874be8ae22b37e033b5e57` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:49.706119 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a98b77-9df0-4e2d-9cf0-e089014427d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e0f1fba09874be8ae22b37e033b5e57)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:49.707937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a98b77-9df0-4e2d-9cf0-e089014427d6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:49.709586 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 673/1355] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:42:49 2022] GET /identity/v3/projects/6e0f1fba09874be8ae22b37e033b5e57 => generated 345 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:42:49.721470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605143c8-d514-4da9-92bd-0a259d9a66c2 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:49.731105 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605143c8-d514-4da9-92bd-0a259d9a66c2 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:49.734724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986ae21-be55-4ae9-8684-ec89e4088076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:49.735445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ae21-be55-4ae9-8684-ec89e4088076 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:49.735792 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ae21-be55-4ae9-8684-ec89e4088076 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:49.736650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ae21-be55-4ae9-8684-ec89e4088076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:49.745953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986ae21-be55-4ae9-8684-ec89e4088076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:49.747394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986ae21-be55-4ae9-8684-ec89e4088076 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:49.757464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 683/1356] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:52.607433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2af46-831f-4d23-9e94-e25399042869 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:52.607968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2af46-831f-4d23-9e94-e25399042869 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:52.607968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2af46-831f-4d23-9e94-e25399042869 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:52.609916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 674/1357] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:52.616157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf375e7-8409-4ff2-a23d-da862d2a7866 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:52.616608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf375e7-8409-4ff2-a23d-da862d2a7866 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:52.616698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf375e7-8409-4ff2-a23d-da862d2a7866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:52.634947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-caf375e7-8409-4ff2-a23d-da862d2a7866 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:52.636139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-caf375e7-8409-4ff2-a23d-da862d2a7866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:52.644505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 684/1358] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:52.682590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2af46-831f-4d23-9e94-e25399042869 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:52.693551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2af46-831f-4d23-9e94-e25399042869 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:52.697023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342ec8b-d85f-4b0e-be0c-9261f08d8bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:52.697647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342ec8b-d85f-4b0e-be0c-9261f08d8bbe service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:52.697926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342ec8b-d85f-4b0e-be0c-9261f08d8bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:52.698200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342ec8b-d85f-4b0e-be0c-9261f08d8bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:52.706871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e342ec8b-d85f-4b0e-be0c-9261f08d8bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:52.708286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e342ec8b-d85f-4b0e-be0c-9261f08d8bbe service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:52.717578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 675/1359] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:42:57.081383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e378e-1da0-47d3-9103-0b0cb3778a08 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:57.081935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e378e-1da0-47d3-9103-0b0cb3778a08 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:57.081935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e378e-1da0-47d3-9103-0b0cb3778a08 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:57.083727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 685/1360] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:42:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:42:57.089349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c934d0-8f53-4cb9-a463-7309dab43627 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:57.089763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c934d0-8f53-4cb9-a463-7309dab43627 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:57.089907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c934d0-8f53-4cb9-a463-7309dab43627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:57.117712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-c5c934d0-8f53-4cb9-a463-7309dab43627 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:42:57.118949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c5c934d0-8f53-4cb9-a463-7309dab43627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:42:57.126951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 676/1361] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:42:57.165918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e378e-1da0-47d3-9103-0b0cb3778a08 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:42:57.177287 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e378e-1da0-47d3-9103-0b0cb3778a08 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:42:57.180900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e677931-bd47-435a-a5b2-a4a4ed4f59ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:42:57.181527 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e677931-bd47-435a-a5b2-a4a4ed4f59ca service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:42:57.181809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e677931-bd47-435a-a5b2-a4a4ed4f59ca service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:42:57.182084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e677931-bd47-435a-a5b2-a4a4ed4f59ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:42:57.191317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e677931-bd47-435a-a5b2-a4a4ed4f59ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:42:57.192802 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e677931-bd47-435a-a5b2-a4a4ed4f59ca service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:42:57.202065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 686/1362] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:02.180049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53113f0-a1a1-42ce-9206-026daaa22f41 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:02.180925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53113f0-a1a1-42ce-9206-026daaa22f41 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:02.181350 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53113f0-a1a1-42ce-9206-026daaa22f41 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:02.183542 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 677/1363] 10.222.0.117 () {54 vars in 926 bytes} [Mon Jan 24 16:43:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:02.188706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff4f86-bc24-4df6-a657-d522b20119ec None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:02.189492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff4f86-bc24-4df6-a657-d522b20119ec None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:02.190445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff4f86-bc24-4df6-a657-d522b20119ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:02.292866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-1eff4f86-bc24-4df6-a657-d522b20119ec None None] MFA Rules not processed for user `15975bd016ed48f9bf5c88845180ebf0`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:02.294066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1eff4f86-bc24-4df6-a657-d522b20119ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:02.384672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 687/1364] 10.222.0.117 () {58 vars in 1023 bytes} [Mon Jan 24 16:43:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:06.696678 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7350-7aa3-44fc-904a-d54e9396a100 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:06.697508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7350-7aa3-44fc-904a-d54e9396a100 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:06.697790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7350-7aa3-44fc-904a-d54e9396a100 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:06.699590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 678/1365] 10.222.0.117 () {54 vars in 926 bytes} [Mon Jan 24 16:43:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:06.704796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cd6e-f8b2-44d2-83a9-7be111068d11 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:06.705305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cd6e-f8b2-44d2-83a9-7be111068d11 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:06.705646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cd6e-f8b2-44d2-83a9-7be111068d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:06.724838 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-7f31cd6e-f8b2-44d2-83a9-7be111068d11 None None] MFA Rules not processed for user `15975bd016ed48f9bf5c88845180ebf0`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:06.726112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7f31cd6e-f8b2-44d2-83a9-7be111068d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:06.735795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 688/1366] 10.222.0.117 () {58 vars in 1023 bytes} [Mon Jan 24 16:43:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:08.360114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5055df-ea72-4725-b7b8-d1b34d140481 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:08.360575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5055df-ea72-4725-b7b8-d1b34d140481 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:08.360693 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5055df-ea72-4725-b7b8-d1b34d140481 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:08.363018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 679/1367] 10.222.0.117 () {54 vars in 926 bytes} [Mon Jan 24 16:43:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:08.368228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b440b-f4e0-4268-97e5-bc38625a1427 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:08.368653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b440b-f4e0-4268-97e5-bc38625a1427 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:08.368862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b440b-f4e0-4268-97e5-bc38625a1427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:08.388612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ff6b440b-f4e0-4268-97e5-bc38625a1427 None None] MFA Rules not processed for user `15975bd016ed48f9bf5c88845180ebf0`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:08.389789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ff6b440b-f4e0-4268-97e5-bc38625a1427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:08.398313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 689/1368] 10.222.0.117 () {58 vars in 1023 bytes} [Mon Jan 24 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:43:12.164562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701b50-d5ee-4d8d-b207-6edb8c7bf033 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:12.165011 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701b50-d5ee-4d8d-b207-6edb8c7bf033 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:12.165117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701b50-d5ee-4d8d-b207-6edb8c7bf033 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:12.168392 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 680/1369] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:12 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:12.172094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff580e7-1f4f-4bb2-8a23-d7a23e6c48b9 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:12.172496 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff580e7-1f4f-4bb2-8a23-d7a23e6c48b9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:12.172648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff580e7-1f4f-4bb2-8a23-d7a23e6c48b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:12.190491 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-bff580e7-1f4f-4bb2-8a23-d7a23e6c48b9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:12.191847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-bff580e7-1f4f-4bb2-8a23-d7a23e6c48b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:12.199597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 690/1370] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:12.247805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00e12f-e1ee-4691-9ed8-2054b6ecab88 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:12.248240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00e12f-e1ee-4691-9ed8-2054b6ecab88 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:12.248608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00e12f-e1ee-4691-9ed8-2054b6ecab88 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:12.250643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 681/1371] 10.222.0.117 () {54 vars in 966 bytes} [Mon Jan 24 16:43:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:12.256021 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89d0cf-1ad0-450c-9e3a-bbf4f71b43bb None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:12.256320 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89d0cf-1ad0-450c-9e3a-bbf4f71b43bb None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:12.256601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89d0cf-1ad0-450c-9e3a-bbf4f71b43bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:12.307689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-cf89d0cf-1ad0-450c-9e3a-bbf4f71b43bb None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:12.309121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-cf89d0cf-1ad0-450c-9e3a-bbf4f71b43bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:12.394505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 691/1372] 10.222.0.117 () {58 vars in 1063 bytes} [Mon Jan 24 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:12.402994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00e12f-e1ee-4691-9ed8-2054b6ecab88 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:12.417886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00e12f-e1ee-4691-9ed8-2054b6ecab88 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:12.423192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21593e05-73f4-4312-b2e7-5c7fb4412689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:12.424419 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21593e05-73f4-4312-b2e7-5c7fb4412689 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:12.424699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21593e05-73f4-4312-b2e7-5c7fb4412689 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:12.424972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21593e05-73f4-4312-b2e7-5c7fb4412689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:12.432913 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21593e05-73f4-4312-b2e7-5c7fb4412689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:12.434472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21593e05-73f4-4312-b2e7-5c7fb4412689 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:12.444525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 682/1373] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:14.906672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2af4-6f45-456a-ae10-2a4dee0701b5 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:14.907224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2af4-6f45-456a-ae10-2a4dee0701b5 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:14.907330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2af4-6f45-456a-ae10-2a4dee0701b5 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:14.909670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 692/1374] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:14.915030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef28f9-c877-4f73-99c3-b965dd8e6770 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:14.915484 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef28f9-c877-4f73-99c3-b965dd8e6770 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:14.915589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef28f9-c877-4f73-99c3-b965dd8e6770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:14.933797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d0ef28f9-c877-4f73-99c3-b965dd8e6770 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:14.935011 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d0ef28f9-c877-4f73-99c3-b965dd8e6770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:14.943952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 683/1375] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:14.990142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd2af4-6f45-456a-ae10-2a4dee0701b5 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:15.005331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd2af4-6f45-456a-ae10-2a4dee0701b5 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:15.011387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e03c76-433e-43bc-a47b-a36e7fbe6b9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:15.012105 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e03c76-433e-43bc-a47b-a36e7fbe6b9f service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:15.012471 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e03c76-433e-43bc-a47b-a36e7fbe6b9f service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:15.012808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e03c76-433e-43bc-a47b-a36e7fbe6b9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:15.021827 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e03c76-433e-43bc-a47b-a36e7fbe6b9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:15.023603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e03c76-433e-43bc-a47b-a36e7fbe6b9f service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:15.036760 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 693/1376] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:17.632023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7613-4ce4-4447-b325-ef0ad30eb858 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:17.632533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7613-4ce4-4447-b325-ef0ad30eb858 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:17.632533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7613-4ce4-4447-b325-ef0ad30eb858 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:17.634305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 684/1377] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:17.639653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad391df6-0a79-4ddf-ab6a-396966e3a951 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:17.640072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad391df6-0a79-4ddf-ab6a-396966e3a951 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:17.640220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad391df6-0a79-4ddf-ab6a-396966e3a951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:17.659968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ad391df6-0a79-4ddf-ab6a-396966e3a951 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:17.661176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ad391df6-0a79-4ddf-ab6a-396966e3a951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:17.669789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 694/1378] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:17.725864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aad99-7773-4df7-beee-b3b3a5cf33f6 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:17.726238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aad99-7773-4df7-beee-b3b3a5cf33f6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:17.726579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aad99-7773-4df7-beee-b3b3a5cf33f6 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:17.728435 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 685/1379] 10.222.0.117 () {54 vars in 966 bytes} [Mon Jan 24 16:43:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:17.733873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da8fc4-f460-4c62-8523-0f3ce74a044c None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:17.734162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da8fc4-f460-4c62-8523-0f3ce74a044c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:17.734438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da8fc4-f460-4c62-8523-0f3ce74a044c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:17.753687 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-63da8fc4-f460-4c62-8523-0f3ce74a044c None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:17.754877 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-63da8fc4-f460-4c62-8523-0f3ce74a044c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:17.764002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 695/1380] 10.222.0.117 () {58 vars in 1063 bytes} [Mon Jan 24 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:17.771654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aad99-7773-4df7-beee-b3b3a5cf33f6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:17.788033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aad99-7773-4df7-beee-b3b3a5cf33f6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:17.793658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4db3c-2277-4bfa-8969-abda2b8ef5c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:17.794600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4db3c-2277-4bfa-8969-abda2b8ef5c7 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:17.795200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4db3c-2277-4bfa-8969-abda2b8ef5c7 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:17.795904 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4db3c-2277-4bfa-8969-abda2b8ef5c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:17.808585 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4db3c-2277-4bfa-8969-abda2b8ef5c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:17.810277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4db3c-2277-4bfa-8969-abda2b8ef5c7 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:17.819681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 686/1381] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:20.144664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390bd7-ebab-4cd6-8107-8f925203e78b None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:20.145226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390bd7-ebab-4cd6-8107-8f925203e78b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:20.145226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390bd7-ebab-4cd6-8107-8f925203e78b None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:20.147039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 696/1382] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:20.152444 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fca2-9937-4dee-b594-a2284f43229a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:20.153235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fca2-9937-4dee-b594-a2284f43229a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:20.153671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fca2-9937-4dee-b594-a2284f43229a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:20.173151 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-dba3fca2-9937-4dee-b594-a2284f43229a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:20.174339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dba3fca2-9937-4dee-b594-a2284f43229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:20.182553 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 687/1383] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:43:20.229766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390bd7-ebab-4cd6-8107-8f925203e78b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:20.245713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390bd7-ebab-4cd6-8107-8f925203e78b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:20.251937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293410a0-42c9-4ff5-9e12-fb457eb9c4c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:20.252682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293410a0-42c9-4ff5-9e12-fb457eb9c4c8 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:20.253091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293410a0-42c9-4ff5-9e12-fb457eb9c4c8 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:20.253465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293410a0-42c9-4ff5-9e12-fb457eb9c4c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:20.263335 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293410a0-42c9-4ff5-9e12-fb457eb9c4c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:20.265032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293410a0-42c9-4ff5-9e12-fb457eb9c4c8 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:20.275094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 697/1384] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:20.326919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c82f23-3b04-4e36-a163-97e4f6ff7cf8 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:20.327599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c82f23-3b04-4e36-a163-97e4f6ff7cf8 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:20.328093 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c82f23-3b04-4e36-a163-97e4f6ff7cf8 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:20.330658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 688/1385] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:20 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:20.338366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7ad44-456a-45ae-8acc-3229b90d44c9 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:20.338727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7ad44-456a-45ae-8acc-3229b90d44c9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:20.338997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7ad44-456a-45ae-8acc-3229b90d44c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:20.367021 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d8a7ad44-456a-45ae-8acc-3229b90d44c9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:20.368567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d8a7ad44-456a-45ae-8acc-3229b90d44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:20.380580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 698/1386] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:20.656146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369670b-cd9f-4905-80ae-5debe58f6810 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:20.656434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369670b-cd9f-4905-80ae-5debe58f6810 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:20.656904 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369670b-cd9f-4905-80ae-5debe58f6810 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:20.659750 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 689/1387] 10.222.0.117 () {54 vars in 968 bytes} [Mon Jan 24 16:43:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:20.664843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8920e-88d2-43a4-b68c-1d882847af79 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:20.665252 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8920e-88d2-43a4-b68c-1d882847af79 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:20.665542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8920e-88d2-43a4-b68c-1d882847af79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:20.714964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-83b8920e-88d2-43a4-b68c-1d882847af79 None None] MFA Rules not processed for user `3c62250938c543d788dd7fd690b5abad`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:20.716147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-83b8920e-88d2-43a4-b68c-1d882847af79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:20.774970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 699/1388] 10.222.0.117 () {58 vars in 1065 bytes} [Mon Jan 24 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:20.785471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369670b-cd9f-4905-80ae-5debe58f6810 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:20.797206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369670b-cd9f-4905-80ae-5debe58f6810 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:20.802131 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf9878-4f24-4a22-a02f-e92e94e0e877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:20.803122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf9878-4f24-4a22-a02f-e92e94e0e877 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:20.803739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf9878-4f24-4a22-a02f-e92e94e0e877 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:20.804205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf9878-4f24-4a22-a02f-e92e94e0e877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:20.814793 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf9878-4f24-4a22-a02f-e92e94e0e877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:20.816591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf9878-4f24-4a22-a02f-e92e94e0e877 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:20.831075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 690/1389] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:22.548182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161bbb1-9bcb-433a-8431-c94e51827455 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:22.548664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161bbb1-9bcb-433a-8431-c94e51827455 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:22.548866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161bbb1-9bcb-433a-8431-c94e51827455 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:22.550604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 700/1390] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:22.556227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd02b-b3a3-4876-944a-9806b0041c87 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:22.556696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd02b-b3a3-4876-944a-9806b0041c87 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:22.556786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd02b-b3a3-4876-944a-9806b0041c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:22.575270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-59cdd02b-b3a3-4876-944a-9806b0041c87 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:22.576463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-59cdd02b-b3a3-4876-944a-9806b0041c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:22.584680 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 691/1391] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:22.629485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161bbb1-9bcb-433a-8431-c94e51827455 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:22.643759 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161bbb1-9bcb-433a-8431-c94e51827455 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:22.649178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36096fa0-cb33-489e-9003-d799702a84e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:22.649990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36096fa0-cb33-489e-9003-d799702a84e8 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:22.650101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36096fa0-cb33-489e-9003-d799702a84e8 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:22.650325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36096fa0-cb33-489e-9003-d799702a84e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:22.659531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36096fa0-cb33-489e-9003-d799702a84e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:22.661122 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36096fa0-cb33-489e-9003-d799702a84e8 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:22.671841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 701/1392] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:24.956658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2412d5c-ecc0-4c37-8fb2-44c7ea1ddebe None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:24.957226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2412d5c-ecc0-4c37-8fb2-44c7ea1ddebe None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:24.957226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2412d5c-ecc0-4c37-8fb2-44c7ea1ddebe None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:24.959219 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 692/1393] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:24.964785 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f92a1-8229-4b78-807f-a10aaa6e7125 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:24.965220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f92a1-8229-4b78-807f-a10aaa6e7125 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:24.965339 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f92a1-8229-4b78-807f-a10aaa6e7125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:24.983526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4b2f92a1-8229-4b78-807f-a10aaa6e7125 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:24.984727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4b2f92a1-8229-4b78-807f-a10aaa6e7125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:24.993622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 702/1394] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:25.037811 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2412d5c-ecc0-4c37-8fb2-44c7ea1ddebe None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:25.052911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2412d5c-ecc0-4c37-8fb2-44c7ea1ddebe None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:25.058677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5bb93-35dc-457e-b3ca-84f158a2b3d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:25.059590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5bb93-35dc-457e-b3ca-84f158a2b3d5 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:25.060078 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5bb93-35dc-457e-b3ca-84f158a2b3d5 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:25.060553 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5bb93-35dc-457e-b3ca-84f158a2b3d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:25.070204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5bb93-35dc-457e-b3ca-84f158a2b3d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:25.072152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5bb93-35dc-457e-b3ca-84f158a2b3d5 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:25.083044 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 693/1395] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:27.437921 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca13c2-8399-4149-820f-3e5b9d7f4af1 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:27.438459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca13c2-8399-4149-820f-3e5b9d7f4af1 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:27.438538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca13c2-8399-4149-820f-3e5b9d7f4af1 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:27.440350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 703/1396] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:27.445866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb303fd5-af19-420f-a3ec-a1b942ff5140 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:27.446291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb303fd5-af19-420f-a3ec-a1b942ff5140 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:27.446421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb303fd5-af19-420f-a3ec-a1b942ff5140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:27.465690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-cb303fd5-af19-420f-a3ec-a1b942ff5140 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:27.466903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-cb303fd5-af19-420f-a3ec-a1b942ff5140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:27.475422 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 694/1397] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:27.518082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca13c2-8399-4149-820f-3e5b9d7f4af1 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:27.534186 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca13c2-8399-4149-820f-3e5b9d7f4af1 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:27.540109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4622a12-e742-4499-98b4-9aca36cf45aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:27.540859 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4622a12-e742-4499-98b4-9aca36cf45aa service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:27.541206 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4622a12-e742-4499-98b4-9aca36cf45aa service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:27.541547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4622a12-e742-4499-98b4-9aca36cf45aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:27.551397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4622a12-e742-4499-98b4-9aca36cf45aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:27.553189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4622a12-e742-4499-98b4-9aca36cf45aa service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:27.564535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 704/1398] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:30.384161 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53870768-5642-497a-b0ab-1103b285c462 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:30.384850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53870768-5642-497a-b0ab-1103b285c462 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:30.384850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53870768-5642-497a-b0ab-1103b285c462 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:30.386548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 695/1399] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:30.392856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1d784-5d27-4266-a859-fe4076c1f7bd None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:30.393429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1d784-5d27-4266-a859-fe4076c1f7bd None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:30.393429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1d784-5d27-4266-a859-fe4076c1f7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:30.411747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-27d1d784-5d27-4266-a859-fe4076c1f7bd None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:30.412855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-27d1d784-5d27-4266-a859-fe4076c1f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:30.420954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 705/1400] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:30.467969 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53870768-5642-497a-b0ab-1103b285c462 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:30.482713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53870768-5642-497a-b0ab-1103b285c462 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:30.488658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb17ad9-afde-412b-a5f5-0e5567f51139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:30.489288 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17ad9-afde-412b-a5f5-0e5567f51139 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:30.489569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17ad9-afde-412b-a5f5-0e5567f51139 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:30.489842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17ad9-afde-412b-a5f5-0e5567f51139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:30.498115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17ad9-afde-412b-a5f5-0e5567f51139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:30.499726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17ad9-afde-412b-a5f5-0e5567f51139 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:30.509717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 696/1401] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:32.819003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0fa19-318e-4280-b8a0-6c8e708c7578 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:32.819683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0fa19-318e-4280-b8a0-6c8e708c7578 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:32.819683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0fa19-318e-4280-b8a0-6c8e708c7578 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:32.821402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 706/1402] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:32.827391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9239cd-7262-4f3a-94bc-547dca5c4c17 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:32.827842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9239cd-7262-4f3a-94bc-547dca5c4c17 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:32.828131 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9239cd-7262-4f3a-94bc-547dca5c4c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:32.849942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-3d9239cd-7262-4f3a-94bc-547dca5c4c17 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:32.851186 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3d9239cd-7262-4f3a-94bc-547dca5c4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:32.859490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 697/1403] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:32.904003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0fa19-318e-4280-b8a0-6c8e708c7578 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:32.920014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0fa19-318e-4280-b8a0-6c8e708c7578 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:32.926686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e7653-9aa9-4c4f-9e05-5ceb5c234398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:32.927400 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e7653-9aa9-4c4f-9e05-5ceb5c234398 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:32.927729 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e7653-9aa9-4c4f-9e05-5ceb5c234398 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:32.928005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e7653-9aa9-4c4f-9e05-5ceb5c234398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:32.936862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e7653-9aa9-4c4f-9e05-5ceb5c234398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:32.938701 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e7653-9aa9-4c4f-9e05-5ceb5c234398 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:32.948880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 707/1404] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:35.349960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e322a9-d52b-4fe7-9da9-bf86fe2fee86 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:35.350527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e322a9-d52b-4fe7-9da9-bf86fe2fee86 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:35.350527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e322a9-d52b-4fe7-9da9-bf86fe2fee86 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:35.352292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 698/1405] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:35.357595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7429f23-9ee2-49ba-b7ea-90a1a21a5d7c None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:35.358343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7429f23-9ee2-49ba-b7ea-90a1a21a5d7c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:35.358625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7429f23-9ee2-49ba-b7ea-90a1a21a5d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:35.380333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a7429f23-9ee2-49ba-b7ea-90a1a21a5d7c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:35.381533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a7429f23-9ee2-49ba-b7ea-90a1a21a5d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:35.389393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 708/1406] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:43:35.442645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e322a9-d52b-4fe7-9da9-bf86fe2fee86 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:35.456487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e322a9-d52b-4fe7-9da9-bf86fe2fee86 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:35.461751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157d4c-0313-4178-a7d5-68a972aadfa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:35.462628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157d4c-0313-4178-a7d5-68a972aadfa1 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:35.462934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157d4c-0313-4178-a7d5-68a972aadfa1 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:35.463206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157d4c-0313-4178-a7d5-68a972aadfa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:35.471020 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157d4c-0313-4178-a7d5-68a972aadfa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:35.472596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157d4c-0313-4178-a7d5-68a972aadfa1 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:35.481947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 699/1407] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:36.215005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f43ce-0e2e-4e8a-b022-276651f7c18f None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:36.215303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f43ce-0e2e-4e8a-b022-276651f7c18f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:36.215580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f43ce-0e2e-4e8a-b022-276651f7c18f None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:36.217466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 709/1408] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:36.223341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf750e-984a-49d9-bb79-3bf3024abe1f None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:36.223637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf750e-984a-49d9-bb79-3bf3024abe1f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:36.223912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf750e-984a-49d9-bb79-3bf3024abe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:36.241266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7faf750e-984a-49d9-bb79-3bf3024abe1f None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:36.242430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7faf750e-984a-49d9-bb79-3bf3024abe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:36.250399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 700/1409] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:36.306597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff9616-6712-4806-81a5-2624f59dad47 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:36.307030 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff9616-6712-4806-81a5-2624f59dad47 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:36.307379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff9616-6712-4806-81a5-2624f59dad47 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:36.309260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 710/1410] 10.222.0.117 () {54 vars in 967 bytes} [Mon Jan 24 16:43:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:36.314661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe643-0776-4709-b90a-c19f66074503 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:36.315061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe643-0776-4709-b90a-c19f66074503 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:36.315340 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe643-0776-4709-b90a-c19f66074503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:36.364216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-5ddfe643-0776-4709-b90a-c19f66074503 None None] MFA Rules not processed for user `2691f7bb4ed84de4bb5901710a96d766`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:36.365404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5ddfe643-0776-4709-b90a-c19f66074503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:36.426647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 701/1411] 10.222.0.117 () {58 vars in 1064 bytes} [Mon Jan 24 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:36.434027 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff9616-6712-4806-81a5-2624f59dad47 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:36.445189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff9616-6712-4806-81a5-2624f59dad47 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:36.448805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31404490-8603-4080-849b-350bf96cdda2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2691f7bb4ed84de4bb5901710a96d766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:36.449435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31404490-8603-4080-849b-350bf96cdda2 service glance] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:36.449719 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31404490-8603-4080-849b-350bf96cdda2 service glance] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:36.449997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31404490-8603-4080-849b-350bf96cdda2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:36.459584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31404490-8603-4080-849b-350bf96cdda2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:36.461029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31404490-8603-4080-849b-350bf96cdda2 service glance] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:36.470613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 711/1412] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:36.884274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fb58-6da9-4cf7-b464-3a5ad9ace41c None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:36.884690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fb58-6da9-4cf7-b464-3a5ad9ace41c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:36.885034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fb58-6da9-4cf7-b464-3a5ad9ace41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:36.931312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-8c10fb58-6da9-4cf7-b464-3a5ad9ace41c None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:36.932584 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8c10fb58-6da9-4cf7-b464-3a5ad9ace41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:36.994429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 702/1413] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:37.040377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef312-00cb-4547-9f3d-f1465d7732a2 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:37.040735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef312-00cb-4547-9f3d-f1465d7732a2 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:37.041180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef312-00cb-4547-9f3d-f1465d7732a2 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:37.043102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 712/1414] 10.222.0.117 () {54 vars in 947 bytes} [Mon Jan 24 16:43:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:37.050167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c80f68-2b39-483f-b97a-5b55c29cf2d5 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:37.050460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c80f68-2b39-483f-b97a-5b55c29cf2d5 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:37.050739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c80f68-2b39-483f-b97a-5b55c29cf2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:37.099454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-52c80f68-2b39-483f-b97a-5b55c29cf2d5 None None] MFA Rules not processed for user `6a6d64d2408e481db883823e98f4d831`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:37.100651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-52c80f68-2b39-483f-b97a-5b55c29cf2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:37.172843 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 703/1415] 10.222.0.117 () {58 vars in 1044 bytes} [Mon Jan 24 16:43:37 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:37.181755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ef312-00cb-4547-9f3d-f1465d7732a2 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:37.195273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ef312-00cb-4547-9f3d-f1465d7732a2 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:37.200141 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c4dff-4332-486d-8d8b-5d2daf56666e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:37.200750 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c4dff-4332-486d-8d8b-5d2daf56666e service swift] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:37.201032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c4dff-4332-486d-8d8b-5d2daf56666e service swift] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:37.201307 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c4dff-4332-486d-8d8b-5d2daf56666e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:37.210048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c4dff-4332-486d-8d8b-5d2daf56666e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:37.211695 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c4dff-4332-486d-8d8b-5d2daf56666e service swift] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:37.220843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 713/1416] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:43:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:43:37.746898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06ead-74e7-42d3-9914-26da78cee676 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:37.747486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06ead-74e7-42d3-9914-26da78cee676 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:37.747486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06ead-74e7-42d3-9914-26da78cee676 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:37.749222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 704/1417] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:37.763951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910205f-84b2-4336-bbbf-7451f79fb7a0 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:37.763951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910205f-84b2-4336-bbbf-7451f79fb7a0 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:37.763951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910205f-84b2-4336-bbbf-7451f79fb7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:37.785950 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-7910205f-84b2-4336-bbbf-7451f79fb7a0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:37.787197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7910205f-84b2-4336-bbbf-7451f79fb7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:37.798181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 714/1418] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:37.852323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06ead-74e7-42d3-9914-26da78cee676 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:37.875697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06ead-74e7-42d3-9914-26da78cee676 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:37.883626 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df892e4f-d0d3-4951-9bef-85d4348d82ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:37.884341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df892e4f-d0d3-4951-9bef-85d4348d82ab service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:37.884757 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df892e4f-d0d3-4951-9bef-85d4348d82ab service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:37.885038 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df892e4f-d0d3-4951-9bef-85d4348d82ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:37.894270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df892e4f-d0d3-4951-9bef-85d4348d82ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:37.895890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df892e4f-d0d3-4951-9bef-85d4348d82ab service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:37.908413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 705/1419] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:43:40.213935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3f2f-45de-4fa5-9af9-086306ddb003 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:40.214524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3f2f-45de-4fa5-9af9-086306ddb003 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:40.214524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3f2f-45de-4fa5-9af9-086306ddb003 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:40.216316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 715/1420] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:43:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:43:40.221925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbecb8-30f5-4077-853f-3bc4e9facee0 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:40.222386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbecb8-30f5-4077-853f-3bc4e9facee0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:40.222481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbecb8-30f5-4077-853f-3bc4e9facee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:40.241552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b9dbecb8-30f5-4077-853f-3bc4e9facee0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:43:40.242803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b9dbecb8-30f5-4077-853f-3bc4e9facee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:43:40.252827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 706/1421] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:43:40.297968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac3f2f-45de-4fa5-9af9-086306ddb003 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:43:40.314146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac3f2f-45de-4fa5-9af9-086306ddb003 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:43:40.319652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad982bfb-197a-451f-a360-8071e1914650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:43:40.320279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad982bfb-197a-451f-a360-8071e1914650 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:43:40.320560 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad982bfb-197a-451f-a360-8071e1914650 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:43:40.320836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad982bfb-197a-451f-a360-8071e1914650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:43:40.329302 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad982bfb-197a-451f-a360-8071e1914650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:43:40.332765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad982bfb-197a-451f-a360-8071e1914650 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:43:40.343913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 716/1422] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:00.220620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d5875-fa25-4317-945f-1ae5c04a9842 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:00.221224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d5875-fa25-4317-945f-1ae5c04a9842 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:00.221224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d5875-fa25-4317-945f-1ae5c04a9842 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:00.222980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 707/1423] 10.222.0.117 () {54 vars in 923 bytes} [Mon Jan 24 16:44:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:00.228359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912bf16-fd63-487d-9b55-67aaea35e105 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:00.228788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912bf16-fd63-487d-9b55-67aaea35e105 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:00.228920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912bf16-fd63-487d-9b55-67aaea35e105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:00.247420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-0912bf16-fd63-487d-9b55-67aaea35e105 None None] MFA Rules not processed for user `15975bd016ed48f9bf5c88845180ebf0`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:00.249200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-0912bf16-fd63-487d-9b55-67aaea35e105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:00.257671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 717/1424] 10.222.0.117 () {58 vars in 1020 bytes} [Mon Jan 24 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:00.271747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f8f4e-e8bc-499b-ac22-0f16c32ba892 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:00.272062 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f8f4e-e8bc-499b-ac22-0f16c32ba892 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:00.272342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f8f4e-e8bc-499b-ac22-0f16c32ba892 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:00.274117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 708/1425] 10.222.0.117 () {54 vars in 923 bytes} [Mon Jan 24 16:44:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:00.278562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c5c2b-1d85-48db-a889-495363230255 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:00.278902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c5c2b-1d85-48db-a889-495363230255 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:00.279277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c5c2b-1d85-48db-a889-495363230255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:00.297690 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-163c5c2b-1d85-48db-a889-495363230255 None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:00.298907 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-163c5c2b-1d85-48db-a889-495363230255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:00.307940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 718/1426] 10.222.0.117 () {58 vars in 1020 bytes} [Mon Jan 24 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:03.023699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827d876-dddf-4755-8bbe-120aee33fb5d None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:03.024260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827d876-dddf-4755-8bbe-120aee33fb5d None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:03.024260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827d876-dddf-4755-8bbe-120aee33fb5d None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:03.026071 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 709/1427] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:44:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:03.031592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fc16b-bfa9-4d3e-93e9-30564fb8ba1d None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:03.032033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fc16b-bfa9-4d3e-93e9-30564fb8ba1d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:03.032140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fc16b-bfa9-4d3e-93e9-30564fb8ba1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:03.051040 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a64fc16b-bfa9-4d3e-93e9-30564fb8ba1d None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:03.052204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a64fc16b-bfa9-4d3e-93e9-30564fb8ba1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:03.059893 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 719/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:03.101682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827d876-dddf-4755-8bbe-120aee33fb5d None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:03.116144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827d876-dddf-4755-8bbe-120aee33fb5d None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:03.121540 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcd94f-ce97-4f8c-91fb-7fdd80f03f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:03.122168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcd94f-ce97-4f8c-91fb-7fdd80f03f72 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:03.122449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcd94f-ce97-4f8c-91fb-7fdd80f03f72 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:03.123385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcd94f-ce97-4f8c-91fb-7fdd80f03f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:03.131430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcd94f-ce97-4f8c-91fb-7fdd80f03f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:03.133041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcd94f-ce97-4f8c-91fb-7fdd80f03f72 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:03.143132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 710/1429] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:04.506611 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42e361-64c7-46f8-867e-22344f18e87d None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:04.507162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42e361-64c7-46f8-867e-22344f18e87d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:04.507162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42e361-64c7-46f8-867e-22344f18e87d None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:04.508924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 720/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:44:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:04.514391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d230db-6f8a-42e2-9c69-b78ac91036bc None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:04.514860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d230db-6f8a-42e2-9c69-b78ac91036bc None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:04.514956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d230db-6f8a-42e2-9c69-b78ac91036bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:04.532980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-46d230db-6f8a-42e2-9c69-b78ac91036bc None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:04.534165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-46d230db-6f8a-42e2-9c69-b78ac91036bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:04.541915 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 711/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:04.707050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42e361-64c7-46f8-867e-22344f18e87d None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:04.722246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42e361-64c7-46f8-867e-22344f18e87d None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:04.727576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a24a2-6612-450e-9a49-e0c9d0121cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:04.728194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a24a2-6612-450e-9a49-e0c9d0121cf2 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:04.728474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a24a2-6612-450e-9a49-e0c9d0121cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:04.728743 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a24a2-6612-450e-9a49-e0c9d0121cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:04.736614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a24a2-6612-450e-9a49-e0c9d0121cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:04.738176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a24a2-6612-450e-9a49-e0c9d0121cf2 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:04.747162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 721/1432] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:06.086608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557f7e8-c9d0-4696-aa6e-b3427a50b99e None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:06.087231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557f7e8-c9d0-4696-aa6e-b3427a50b99e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:06.087231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557f7e8-c9d0-4696-aa6e-b3427a50b99e None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:06.089030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 712/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:44:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:06.094093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08257721-fd26-40c8-bab8-160b60a10d9c None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:06.094524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08257721-fd26-40c8-bab8-160b60a10d9c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:06.094788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08257721-fd26-40c8-bab8-160b60a10d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:06.113672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-08257721-fd26-40c8-bab8-160b60a10d9c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:06.114905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-08257721-fd26-40c8-bab8-160b60a10d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:06.124633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 722/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:06.300850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557f7e8-c9d0-4696-aa6e-b3427a50b99e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:06.316960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557f7e8-c9d0-4696-aa6e-b3427a50b99e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:06.322527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52195379-205b-45a8-9cc5-37b60dc83325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:06.323187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52195379-205b-45a8-9cc5-37b60dc83325 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:06.323462 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52195379-205b-45a8-9cc5-37b60dc83325 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:06.323740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52195379-205b-45a8-9cc5-37b60dc83325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:06.334829 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52195379-205b-45a8-9cc5-37b60dc83325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:06.336898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52195379-205b-45a8-9cc5-37b60dc83325 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:06.347944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 713/1435] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:07.682408 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0d269-5a68-475e-a8a4-cd1463500239 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:07.682974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0d269-5a68-475e-a8a4-cd1463500239 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:07.683088 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0d269-5a68-475e-a8a4-cd1463500239 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:07.684808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 723/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:44:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:07.690719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a37743-e912-4eb3-a674-7ef25735a1bd None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:07.691587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a37743-e912-4eb3-a674-7ef25735a1bd None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:07.692129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a37743-e912-4eb3-a674-7ef25735a1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:07.711746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-f0a37743-e912-4eb3-a674-7ef25735a1bd None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:07.712948 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f0a37743-e912-4eb3-a674-7ef25735a1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:07.720893 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 714/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:07.877025 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0d269-5a68-475e-a8a4-cd1463500239 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:07.898533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0d269-5a68-475e-a8a4-cd1463500239 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:07.908246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4d905-dc8f-4ee8-9d31-e251023c4063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:07.909351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4d905-dc8f-4ee8-9d31-e251023c4063 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:07.909850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4d905-dc8f-4ee8-9d31-e251023c4063 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:07.910282 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4d905-dc8f-4ee8-9d31-e251023c4063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:07.918604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4d905-dc8f-4ee8-9d31-e251023c4063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:07.920852 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4d905-dc8f-4ee8-9d31-e251023c4063 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:07.929997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 724/1438] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:44:09.256557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8acf4d-0acd-4a10-b00a-f16bdbb1f0b2 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:09.257154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8acf4d-0acd-4a10-b00a-f16bdbb1f0b2 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:09.257154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8acf4d-0acd-4a10-b00a-f16bdbb1f0b2 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:09.258836 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 715/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:44:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:09.264788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c825c35-3248-4313-aeb1-6e4000aee594 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:09.265219 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c825c35-3248-4313-aeb1-6e4000aee594 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:09.265343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c825c35-3248-4313-aeb1-6e4000aee594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:09.284172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-2c825c35-3248-4313-aeb1-6e4000aee594 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:09.285354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2c825c35-3248-4313-aeb1-6e4000aee594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:09.293019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 725/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:09.448623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8acf4d-0acd-4a10-b00a-f16bdbb1f0b2 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:09.464109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8acf4d-0acd-4a10-b00a-f16bdbb1f0b2 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:09.469569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce82aeb-cbef-4adc-9e6c-077c839bd842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:09.470195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce82aeb-cbef-4adc-9e6c-077c839bd842 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:09.470479 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce82aeb-cbef-4adc-9e6c-077c839bd842 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:09.470787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce82aeb-cbef-4adc-9e6c-077c839bd842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:09.478734 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce82aeb-cbef-4adc-9e6c-077c839bd842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:09.480356 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce82aeb-cbef-4adc-9e6c-077c839bd842 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:09.489477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 716/1441] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:10.748740 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a948-d26f-4cfb-8df7-eeb4ec77685a None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:10.749296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a948-d26f-4cfb-8df7-eeb4ec77685a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:10.749296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a948-d26f-4cfb-8df7-eeb4ec77685a None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:10.751058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 726/1442] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:44:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:10.756091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d515ef5-3c34-480c-833f-34f282c4cd00 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:10.756521 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d515ef5-3c34-480c-833f-34f282c4cd00 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:10.756630 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d515ef5-3c34-480c-833f-34f282c4cd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:10.774554 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-0d515ef5-3c34-480c-833f-34f282c4cd00 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:10.775946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0d515ef5-3c34-480c-833f-34f282c4cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:10.784013 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 717/1443] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:10.941469 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151a948-d26f-4cfb-8df7-eeb4ec77685a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:10.956138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151a948-d26f-4cfb-8df7-eeb4ec77685a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:10.961704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aad75d-507b-43a7-9fb8-2e0d83f64c86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:10.962319 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aad75d-507b-43a7-9fb8-2e0d83f64c86 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:10.962602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aad75d-507b-43a7-9fb8-2e0d83f64c86 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:10.962918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aad75d-507b-43a7-9fb8-2e0d83f64c86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:10.970997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aad75d-507b-43a7-9fb8-2e0d83f64c86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:10.972557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aad75d-507b-43a7-9fb8-2e0d83f64c86 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:10.981780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 727/1444] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:12.247188 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10398fc9-2a25-42d9-9675-15a3fde6ddc8 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:12.247762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10398fc9-2a25-42d9-9675-15a3fde6ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:12.247762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10398fc9-2a25-42d9-9675-15a3fde6ddc8 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:12.249535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 718/1445] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:44:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:12.254403 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f1c27-8fc3-4694-8547-14ab5327a9db None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:12.254814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f1c27-8fc3-4694-8547-14ab5327a9db None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:12.254986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f1c27-8fc3-4694-8547-14ab5327a9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:12.273543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-2e9f1c27-8fc3-4694-8547-14ab5327a9db None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:12.274733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2e9f1c27-8fc3-4694-8547-14ab5327a9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:12.283042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 728/1446] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:12.445181 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10398fc9-2a25-42d9-9675-15a3fde6ddc8 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:12.461724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10398fc9-2a25-42d9-9675-15a3fde6ddc8 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:12.467955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def08f9c-3be3-4f2b-ab8c-90dac9f54ba9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:12.468576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08f9c-3be3-4f2b-ab8c-90dac9f54ba9 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:12.468852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08f9c-3be3-4f2b-ab8c-90dac9f54ba9 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:12.469123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08f9c-3be3-4f2b-ab8c-90dac9f54ba9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:12.477815 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def08f9c-3be3-4f2b-ab8c-90dac9f54ba9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:12.479441 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def08f9c-3be3-4f2b-ab8c-90dac9f54ba9 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:12.489576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 719/1447] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:13.773494 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb5a96-6445-4f39-a7a1-7db902f33329 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:13.774056 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb5a96-6445-4f39-a7a1-7db902f33329 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:13.774056 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb5a96-6445-4f39-a7a1-7db902f33329 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:13.775849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 729/1448] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:44:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:13.780773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50218985-6003-4cc7-9a32-205b7b44e8ad None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:13.781213 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50218985-6003-4cc7-9a32-205b7b44e8ad None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:13.781312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50218985-6003-4cc7-9a32-205b7b44e8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:13.800706 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-50218985-6003-4cc7-9a32-205b7b44e8ad None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:13.801931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-50218985-6003-4cc7-9a32-205b7b44e8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:13.811055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 720/1449] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:13.965218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb5a96-6445-4f39-a7a1-7db902f33329 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:13.980200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb5a96-6445-4f39-a7a1-7db902f33329 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:13.986704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35ecad-3c23-49a7-a2a9-1554335ae242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:13.987355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35ecad-3c23-49a7-a2a9-1554335ae242 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:13.987637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35ecad-3c23-49a7-a2a9-1554335ae242 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:13.987912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35ecad-3c23-49a7-a2a9-1554335ae242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:13.995764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35ecad-3c23-49a7-a2a9-1554335ae242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:13.997881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35ecad-3c23-49a7-a2a9-1554335ae242 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:14.006954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 730/1450] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:15.259748 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d333a56-ef0b-4032-8668-88c41a4ef9d5 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:15.260309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d333a56-ef0b-4032-8668-88c41a4ef9d5 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:15.260309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d333a56-ef0b-4032-8668-88c41a4ef9d5 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:15.262102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 721/1451] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:44:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:15.267445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9b8db-839c-42b3-a6c0-d498a857824a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:15.267881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9b8db-839c-42b3-a6c0-d498a857824a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:15.268002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9b8db-839c-42b3-a6c0-d498a857824a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:15.285801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-42e9b8db-839c-42b3-a6c0-d498a857824a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:15.287031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-42e9b8db-839c-42b3-a6c0-d498a857824a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:15.295397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 731/1452] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:15.446613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d333a56-ef0b-4032-8668-88c41a4ef9d5 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:15.461155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d333a56-ef0b-4032-8668-88c41a4ef9d5 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:15.467287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28f86b-261e-43c8-a1e9-cfdc2ac649b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:15.467909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f86b-261e-43c8-a1e9-cfdc2ac649b9 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:15.468190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f86b-261e-43c8-a1e9-cfdc2ac649b9 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:15.468465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f86b-261e-43c8-a1e9-cfdc2ac649b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:15.476600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28f86b-261e-43c8-a1e9-cfdc2ac649b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:15.478297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28f86b-261e-43c8-a1e9-cfdc2ac649b9 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:15.488416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 722/1453] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:17.619398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0347b-7a9f-4d97-9a1c-0de3bab3b588 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:17.619953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0347b-7a9f-4d97-9a1c-0de3bab3b588 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:17.619953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0347b-7a9f-4d97-9a1c-0de3bab3b588 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:17.622319 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 732/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:44:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:17.627619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c5238-aee8-4268-bcee-03a4fc025aab None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:17.628051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c5238-aee8-4268-bcee-03a4fc025aab None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:17.628162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c5238-aee8-4268-bcee-03a4fc025aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:17.646176 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-2f4c5238-aee8-4268-bcee-03a4fc025aab None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:17.647404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-2f4c5238-aee8-4268-bcee-03a4fc025aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:17.655075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 723/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:17.694334 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0347b-7a9f-4d97-9a1c-0de3bab3b588 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:17.705897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0347b-7a9f-4d97-9a1c-0de3bab3b588 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:17.709500 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2077e-a11c-4a56-b908-668441e074b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:17.710384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2077e-a11c-4a56-b908-668441e074b3 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:17.710666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2077e-a11c-4a56-b908-668441e074b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:17.710972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2077e-a11c-4a56-b908-668441e074b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:17.720673 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2077e-a11c-4a56-b908-668441e074b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:17.722091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2077e-a11c-4a56-b908-668441e074b3 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:17.731423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 733/1456] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:20.110251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13456a81-9e25-43d3-a645-134a2693feae None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:20.110886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13456a81-9e25-43d3-a645-134a2693feae None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:20.110886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13456a81-9e25-43d3-a645-134a2693feae None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:20.112615 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 724/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:44:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:20.118022 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ce45-6927-4ffa-84e3-0de9f1fe8b9c None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:20.118473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ce45-6927-4ffa-84e3-0de9f1fe8b9c None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:20.118576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ce45-6927-4ffa-84e3-0de9f1fe8b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:20.137171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-cb54ce45-6927-4ffa-84e3-0de9f1fe8b9c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:20.138371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-cb54ce45-6927-4ffa-84e3-0de9f1fe8b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:20.146210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 734/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:20.186224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13456a81-9e25-43d3-a645-134a2693feae None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:20.196655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13456a81-9e25-43d3-a645-134a2693feae None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:20.200261 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca94d52-6d51-4c87-ae0e-311efe77caea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:20.200877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca94d52-6d51-4c87-ae0e-311efe77caea service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:20.201155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca94d52-6d51-4c87-ae0e-311efe77caea service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:20.201429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca94d52-6d51-4c87-ae0e-311efe77caea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:20.210240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca94d52-6d51-4c87-ae0e-311efe77caea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:20.211672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca94d52-6d51-4c87-ae0e-311efe77caea service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:20.221127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 725/1459] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:22.846806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cf546-1222-4d11-b444-5b9a8ba57689 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:22.847394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cf546-1222-4d11-b444-5b9a8ba57689 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:22.847394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cf546-1222-4d11-b444-5b9a8ba57689 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:22.849208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 735/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:44:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:22.854472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285dd2-d05c-45ac-8fca-dedf7918a995 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:22.854895 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285dd2-d05c-45ac-8fca-dedf7918a995 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:22.855058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285dd2-d05c-45ac-8fca-dedf7918a995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:22.873868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b1285dd2-d05c-45ac-8fca-dedf7918a995 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:22.875082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b1285dd2-d05c-45ac-8fca-dedf7918a995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:22.882777 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 726/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:22.922006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cf546-1222-4d11-b444-5b9a8ba57689 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:22.932504 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cf546-1222-4d11-b444-5b9a8ba57689 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:22.937032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effd107-95ae-4f79-a609-a4173dce74d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:22.937656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd107-95ae-4f79-a609-a4173dce74d3 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:22.937939 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd107-95ae-4f79-a609-a4173dce74d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:22.938218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd107-95ae-4f79-a609-a4173dce74d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:22.947226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effd107-95ae-4f79-a609-a4173dce74d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:22.948673 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effd107-95ae-4f79-a609-a4173dce74d3 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:22.958361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 736/1462] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:25.331582 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49729159-66ac-4bf8-9e62-203c9843f8db None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:25.332145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49729159-66ac-4bf8-9e62-203c9843f8db None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:25.332145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49729159-66ac-4bf8-9e62-203c9843f8db None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:25.333886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 727/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:44:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:25.339417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e32e73-e814-4cb8-a918-cf68201cc987 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:25.340665 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e32e73-e814-4cb8-a918-cf68201cc987 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:25.340665 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e32e73-e814-4cb8-a918-cf68201cc987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:25.358769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a3e32e73-e814-4cb8-a918-cf68201cc987 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:25.359968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a3e32e73-e814-4cb8-a918-cf68201cc987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:25.367656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 737/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:25.407250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49729159-66ac-4bf8-9e62-203c9843f8db None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:25.417697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49729159-66ac-4bf8-9e62-203c9843f8db None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:25.421810 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d53474-e2a7-47f5-b16f-c23db0de0f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:25.422441 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d53474-e2a7-47f5-b16f-c23db0de0f98 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:25.422726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d53474-e2a7-47f5-b16f-c23db0de0f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:25.423040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d53474-e2a7-47f5-b16f-c23db0de0f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:25.431765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d53474-e2a7-47f5-b16f-c23db0de0f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:25.433184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d53474-e2a7-47f5-b16f-c23db0de0f98 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:25.442484 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 728/1465] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:27.719576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b69c50-f4e6-4cff-8867-2a965d12f4e3 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:27.720121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b69c50-f4e6-4cff-8867-2a965d12f4e3 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:27.720121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b69c50-f4e6-4cff-8867-2a965d12f4e3 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:27.721945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 738/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:44:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:44:27.727737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2d6d-fbb4-4700-a48c-f8157c6f0125 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:27.728202 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2d6d-fbb4-4700-a48c-f8157c6f0125 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:27.728296 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2d6d-fbb4-4700-a48c-f8157c6f0125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:27.747015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-947f2d6d-fbb4-4700-a48c-f8157c6f0125 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:27.748241 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-947f2d6d-fbb4-4700-a48c-f8157c6f0125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:27.756045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 729/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:27.795252 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b69c50-f4e6-4cff-8867-2a965d12f4e3 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:27.805604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b69c50-f4e6-4cff-8867-2a965d12f4e3 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:27.809468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56639555-0bd9-4d06-bb32-e91f013c0ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:27.810094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639555-0bd9-4d06-bb32-e91f013c0ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:27.810382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639555-0bd9-4d06-bb32-e91f013c0ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:27.810658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639555-0bd9-4d06-bb32-e91f013c0ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:27.819409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56639555-0bd9-4d06-bb32-e91f013c0ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:27.820835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56639555-0bd9-4d06-bb32-e91f013c0ac3 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:27.831180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 739/1468] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:30.133586 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca5a72-e27c-4391-b141-1af6b42fd05b None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:30.134164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca5a72-e27c-4391-b141-1af6b42fd05b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:30.134164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca5a72-e27c-4391-b141-1af6b42fd05b None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:30.135933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 730/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:44:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:30.142351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f65f-e54a-458e-be32-35af5b0ba52a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:30.142818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f65f-e54a-458e-be32-35af5b0ba52a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:30.142935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f65f-e54a-458e-be32-35af5b0ba52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:30.161478 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-6db0f65f-e54a-458e-be32-35af5b0ba52a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:30.162651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6db0f65f-e54a-458e-be32-35af5b0ba52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:30.170672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 740/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:30.208858 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca5a72-e27c-4391-b141-1af6b42fd05b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:30.220703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca5a72-e27c-4391-b141-1af6b42fd05b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:30.224308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae074a5-f078-4c9c-996d-6ba1b064700c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:30.224930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae074a5-f078-4c9c-996d-6ba1b064700c service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:30.225211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae074a5-f078-4c9c-996d-6ba1b064700c service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:30.225485 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae074a5-f078-4c9c-996d-6ba1b064700c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:30.234606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae074a5-f078-4c9c-996d-6ba1b064700c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:30.236213 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae074a5-f078-4c9c-996d-6ba1b064700c service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:30.246151 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 731/1471] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:32.570848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a54ba-66fb-497d-828f-de548a14e07d None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:32.571399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a54ba-66fb-497d-828f-de548a14e07d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:32.571399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a54ba-66fb-497d-828f-de548a14e07d None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:32.573177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 741/1472] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:44:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:32.579595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626cef-d55f-46eb-b2b3-d4c940f9011c None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:32.580039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626cef-d55f-46eb-b2b3-d4c940f9011c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:32.580143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626cef-d55f-46eb-b2b3-d4c940f9011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:32.598434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ba626cef-d55f-46eb-b2b3-d4c940f9011c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:32.599653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ba626cef-d55f-46eb-b2b3-d4c940f9011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:32.607624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 732/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:32.646033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a54ba-66fb-497d-828f-de548a14e07d None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:32.656809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a54ba-66fb-497d-828f-de548a14e07d None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:32.660330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282ad4b-9d6d-4e89-a5c2-fcaf20f6645c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:32.660877 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282ad4b-9d6d-4e89-a5c2-fcaf20f6645c service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:32.661153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282ad4b-9d6d-4e89-a5c2-fcaf20f6645c service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:32.661424 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282ad4b-9d6d-4e89-a5c2-fcaf20f6645c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:32.670074 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282ad4b-9d6d-4e89-a5c2-fcaf20f6645c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:32.671507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282ad4b-9d6d-4e89-a5c2-fcaf20f6645c service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:32.680407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 742/1474] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:34.984075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46d17-b3b2-4df3-8474-69737e725162 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:34.984618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46d17-b3b2-4df3-8474-69737e725162 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:34.984618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46d17-b3b2-4df3-8474-69737e725162 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:34.986397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 733/1475] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:44:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:34.991743 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30f99-56c5-4245-b3a0-f3c286854f6a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:34.992185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30f99-56c5-4245-b3a0-f3c286854f6a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:34.992294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30f99-56c5-4245-b3a0-f3c286854f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:35.009669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-64b30f99-56c5-4245-b3a0-f3c286854f6a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:35.011017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-64b30f99-56c5-4245-b3a0-f3c286854f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:35.018896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 743/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:44:35.058203 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b46d17-b3b2-4df3-8474-69737e725162 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:35.068764 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b46d17-b3b2-4df3-8474-69737e725162 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:35.072285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39d23b-15fe-489f-8bf3-ec0ab23058dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:35.072913 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d23b-15fe-489f-8bf3-ec0ab23058dc service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:35.073197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d23b-15fe-489f-8bf3-ec0ab23058dc service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:35.073598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d23b-15fe-489f-8bf3-ec0ab23058dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:35.082341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39d23b-15fe-489f-8bf3-ec0ab23058dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:35.083797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39d23b-15fe-489f-8bf3-ec0ab23058dc service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:35.093804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 734/1477] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:37.328258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691a2cd-2a98-4a8b-8ef8-117067a431dd None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:37.328815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691a2cd-2a98-4a8b-8ef8-117067a431dd None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:37.328815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691a2cd-2a98-4a8b-8ef8-117067a431dd None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:37.330617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 744/1478] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:44:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:37.336396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c91b3-f615-4429-b9fd-157e77fbb844 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:37.336870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c91b3-f615-4429-b9fd-157e77fbb844 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:37.337075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c91b3-f615-4429-b9fd-157e77fbb844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:37.354936 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ef0c91b3-f615-4429-b9fd-157e77fbb844 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:37.356120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ef0c91b3-f615-4429-b9fd-157e77fbb844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:37.364172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 735/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:37.401642 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691a2cd-2a98-4a8b-8ef8-117067a431dd None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:37.412114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691a2cd-2a98-4a8b-8ef8-117067a431dd None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:37.415542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca996a-11fd-4eba-967f-6aba6e6899d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:37.416166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca996a-11fd-4eba-967f-6aba6e6899d3 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:37.416448 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca996a-11fd-4eba-967f-6aba6e6899d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:37.416725 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca996a-11fd-4eba-967f-6aba6e6899d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:37.425523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca996a-11fd-4eba-967f-6aba6e6899d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:37.426970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca996a-11fd-4eba-967f-6aba6e6899d3 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:37.436781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 745/1480] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:39.663039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d70def-70d3-446f-b921-a5908b90986c None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:39.663581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d70def-70d3-446f-b921-a5908b90986c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:39.663581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d70def-70d3-446f-b921-a5908b90986c None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:39.665401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 736/1481] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:44:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:39.670996 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513e66e-24ae-44dd-af27-5f7c6ccf1fa4 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:39.671450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513e66e-24ae-44dd-af27-5f7c6ccf1fa4 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:39.671548 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513e66e-24ae-44dd-af27-5f7c6ccf1fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:39.690272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d513e66e-24ae-44dd-af27-5f7c6ccf1fa4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:39.691489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d513e66e-24ae-44dd-af27-5f7c6ccf1fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:39.700162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 746/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:39.737713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d70def-70d3-446f-b921-a5908b90986c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:39.749442 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d70def-70d3-446f-b921-a5908b90986c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:39.752996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776f0b-6cc7-4294-b50f-154bb60bbd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:39.753622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776f0b-6cc7-4294-b50f-154bb60bbd58 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:39.753907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776f0b-6cc7-4294-b50f-154bb60bbd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:39.754195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776f0b-6cc7-4294-b50f-154bb60bbd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:39.763217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35776f0b-6cc7-4294-b50f-154bb60bbd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:39.764638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35776f0b-6cc7-4294-b50f-154bb60bbd58 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:39.773814 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 737/1483] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:58.156156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0c4f-330f-4cad-9d58-1d373aabe354 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:58.156631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0c4f-330f-4cad-9d58-1d373aabe354 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:58.156738 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0c4f-330f-4cad-9d58-1d373aabe354 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:58.158485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 747/1484] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:44:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:58.163922 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221504-8d7e-4d79-ae9a-8e8d844659b6 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:58.164372 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221504-8d7e-4d79-ae9a-8e8d844659b6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:58.164476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221504-8d7e-4d79-ae9a-8e8d844659b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:58.182971 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-14221504-8d7e-4d79-ae9a-8e8d844659b6 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:58.184248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-14221504-8d7e-4d79-ae9a-8e8d844659b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:58.192010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 738/1485] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:58.239396 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b66f-edba-4e08-aeba-ea44c1b24669 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:58.239686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b66f-edba-4e08-aeba-ea44c1b24669 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:58.239968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b66f-edba-4e08-aeba-ea44c1b24669 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:58.241730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 748/1486] 10.222.0.117 () {54 vars in 967 bytes} [Mon Jan 24 16:44:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:44:58.246546 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ff2b6-e5d3-4829-825b-e1bcfc3651f4 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:58.246976 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ff2b6-e5d3-4829-825b-e1bcfc3651f4 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:58.247261 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ff2b6-e5d3-4829-825b-e1bcfc3651f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:58.265504 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-5c1ff2b6-e5d3-4829-825b-e1bcfc3651f4 None None] MFA Rules not processed for user `2691f7bb4ed84de4bb5901710a96d766`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:44:58.266697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5c1ff2b6-e5d3-4829-825b-e1bcfc3651f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:44:58.273304 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 739/1487] 10.222.0.117 () {58 vars in 1064 bytes} [Mon Jan 24 16:44:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:44:58.281099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9b66f-edba-4e08-aeba-ea44c1b24669 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:44:58.291778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9b66f-edba-4e08-aeba-ea44c1b24669 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:44:58.295919 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951330cd-a238-46e8-a648-03918e618724 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2691f7bb4ed84de4bb5901710a96d766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:44:58.296543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951330cd-a238-46e8-a648-03918e618724 service glance] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:44:58.296824 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951330cd-a238-46e8-a648-03918e618724 service glance] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:44:58.297101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951330cd-a238-46e8-a648-03918e618724 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:44:58.305849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951330cd-a238-46e8-a648-03918e618724 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:44:58.307301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951330cd-a238-46e8-a648-03918e618724 service glance] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:44:58.316621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 749/1488] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:45:00.661316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cd2c3-5441-484d-9211-2edb8821dae6 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:00.661880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cd2c3-5441-484d-9211-2edb8821dae6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:00.661880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cd2c3-5441-484d-9211-2edb8821dae6 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:00.663712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 740/1489] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:45:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:45:00.669788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d354-2195-4926-9d70-46fc4f0c3ee4 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:00.670290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d354-2195-4926-9d70-46fc4f0c3ee4 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:00.670404 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d354-2195-4926-9d70-46fc4f0c3ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:00.687624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-cfb6d354-2195-4926-9d70-46fc4f0c3ee4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:45:00.688786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-cfb6d354-2195-4926-9d70-46fc4f0c3ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:45:00.696350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 750/1490] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:45:00.720811 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cd2c3-5441-484d-9211-2edb8821dae6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:45:00.733263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cd2c3-5441-484d-9211-2edb8821dae6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:45:00.737677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8efc75-bea9-43ab-a374-e248f11f4b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:45:00.738308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8efc75-bea9-43ab-a374-e248f11f4b1d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:00.738589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8efc75-bea9-43ab-a374-e248f11f4b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:00.738902 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8efc75-bea9-43ab-a374-e248f11f4b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:00.739640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8efc75-bea9-43ab-a374-e248f11f4b1d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:45:00.741472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8efc75-bea9-43ab-a374-e248f11f4b1d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:45:00.755045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 741/1491] 10.222.0.117 () {56 vars in 1113 bytes} [Mon Jan 24 16:45:00 2022] GET /identity/v3/projects => generated 2562 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:45:02.999414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e23ea3-b9d7-42e8-8543-10cb29bbb12d None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:02.999984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e23ea3-b9d7-42e8-8543-10cb29bbb12d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:02.999984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e23ea3-b9d7-42e8-8543-10cb29bbb12d None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:03.001751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 751/1492] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:45:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:45:03.007293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56887f-511b-4013-b2a0-47f7ef93ddf4 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:03.007741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56887f-511b-4013-b2a0-47f7ef93ddf4 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:03.008891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56887f-511b-4013-b2a0-47f7ef93ddf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:03.028308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-4f56887f-511b-4013-b2a0-47f7ef93ddf4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:45:03.029508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-4f56887f-511b-4013-b2a0-47f7ef93ddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:45:03.037157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 742/1493] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:45:03.078705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e23ea3-b9d7-42e8-8543-10cb29bbb12d None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:45:03.093557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e23ea3-b9d7-42e8-8543-10cb29bbb12d None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:45:03.098927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49ff86-75ab-4b02-bec2-11ba355101ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:45:03.099549 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49ff86-75ab-4b02-bec2-11ba355101ab service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:03.099830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49ff86-75ab-4b02-bec2-11ba355101ab service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:03.100109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49ff86-75ab-4b02-bec2-11ba355101ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:03.108263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49ff86-75ab-4b02-bec2-11ba355101ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:45:03.109851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49ff86-75ab-4b02-bec2-11ba355101ab service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:45:03.119138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 752/1494] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:45:05.506226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3a2b0-79b3-4a93-b7e8-022ccd540d2e None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:05.506778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3a2b0-79b3-4a93-b7e8-022ccd540d2e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:05.506778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3a2b0-79b3-4a93-b7e8-022ccd540d2e None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:05.508516 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 743/1495] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:45:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:45:05.513735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cffe7-e302-4895-af3b-f179a267c341 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:05.514126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cffe7-e302-4895-af3b-f179a267c341 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:05.514280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cffe7-e302-4895-af3b-f179a267c341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:05.531595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-870cffe7-e302-4895-af3b-f179a267c341 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:45:05.532948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-870cffe7-e302-4895-af3b-f179a267c341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:45:05.540381 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 753/1496] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:45:05.579377 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3a2b0-79b3-4a93-b7e8-022ccd540d2e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:45:05.590883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3a2b0-79b3-4a93-b7e8-022ccd540d2e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:45:05.594469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f09427-16ef-4ca3-b8ea-e821ad3ece57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:45:05.595133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f09427-16ef-4ca3-b8ea-e821ad3ece57 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:05.595414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f09427-16ef-4ca3-b8ea-e821ad3ece57 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:05.595687 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f09427-16ef-4ca3-b8ea-e821ad3ece57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:05.605130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f09427-16ef-4ca3-b8ea-e821ad3ece57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:45:05.606569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f09427-16ef-4ca3-b8ea-e821ad3ece57 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:45:05.615953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 744/1497] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:45:07.950712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c01da-7342-4c68-b22a-7d91f9825eb4 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:07.951303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c01da-7342-4c68-b22a-7d91f9825eb4 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:07.951303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c01da-7342-4c68-b22a-7d91f9825eb4 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:07.953068 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 754/1498] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:45:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:45:07.958830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d755-a946-4095-9667-e49433071645 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:07.959252 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d755-a946-4095-9667-e49433071645 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:07.959446 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d755-a946-4095-9667-e49433071645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:07.976947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d520d755-a946-4095-9667-e49433071645 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:45:07.978117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d520d755-a946-4095-9667-e49433071645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:45:07.985755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 745/1499] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:45:08.025000 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c01da-7342-4c68-b22a-7d91f9825eb4 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:45:08.035572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c01da-7342-4c68-b22a-7d91f9825eb4 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:45:08.039147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93437d64-5e35-4063-9049-ffb7663b46b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:45:08.039771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437d64-5e35-4063-9049-ffb7663b46b6 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:08.040053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437d64-5e35-4063-9049-ffb7663b46b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:08.040326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437d64-5e35-4063-9049-ffb7663b46b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:08.049629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93437d64-5e35-4063-9049-ffb7663b46b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:45:08.051442 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93437d64-5e35-4063-9049-ffb7663b46b6 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:45:08.061782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 755/1500] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:45:10.365206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b50a3-0dfc-42b9-8f4e-9d8fd7bd41ec None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:10.365775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b50a3-0dfc-42b9-8f4e-9d8fd7bd41ec None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:10.365775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b50a3-0dfc-42b9-8f4e-9d8fd7bd41ec None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:10.367771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 746/1501] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:45:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:45:10.373660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d7c1a-74db-4727-b4ee-fa1e59fe801d None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:10.374070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d7c1a-74db-4727-b4ee-fa1e59fe801d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:10.374189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d7c1a-74db-4727-b4ee-fa1e59fe801d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:10.394002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4c4d7c1a-74db-4727-b4ee-fa1e59fe801d None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:45:10.395206 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4c4d7c1a-74db-4727-b4ee-fa1e59fe801d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:45:10.403160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 756/1502] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:45:10.438137 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b50a3-0dfc-42b9-8f4e-9d8fd7bd41ec None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:45:10.451266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b50a3-0dfc-42b9-8f4e-9d8fd7bd41ec None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:45:10.455728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce60e6-8f41-4afe-90ba-98f6bdd00174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:45:10.456589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce60e6-8f41-4afe-90ba-98f6bdd00174 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:10.456874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce60e6-8f41-4afe-90ba-98f6bdd00174 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:10.457150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce60e6-8f41-4afe-90ba-98f6bdd00174 admin admin] PATH_INFO: `/v3/projects/6e0f1fba09874be8ae22b37e033b5e57` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:10.458636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce60e6-8f41-4afe-90ba-98f6bdd00174 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e0f1fba09874be8ae22b37e033b5e57)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:45:10.460449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce60e6-8f41-4afe-90ba-98f6bdd00174 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:45:10.462115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 747/1503] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:45:10 2022] GET /identity/v3/projects/6e0f1fba09874be8ae22b37e033b5e57 => generated 345 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:45:10.473713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d7c1a-74db-4727-b4ee-fa1e59fe801d None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:45:10.483660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d7c1a-74db-4727-b4ee-fa1e59fe801d None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:45:10.487194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d0d1-0f8d-4ae0-8fbe-13b65b461020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:45:10.487814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d0d1-0f8d-4ae0-8fbe-13b65b461020 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:10.488089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d0d1-0f8d-4ae0-8fbe-13b65b461020 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:10.488355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d0d1-0f8d-4ae0-8fbe-13b65b461020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:10.497604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2d0d1-0f8d-4ae0-8fbe-13b65b461020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:45:10.499040 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2d0d1-0f8d-4ae0-8fbe-13b65b461020 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:45:10.508003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 757/1504] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:45:13.034885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5960097-9dc8-4cdf-af06-f5a6402309c0 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:13.035487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5960097-9dc8-4cdf-af06-f5a6402309c0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:13.035487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5960097-9dc8-4cdf-af06-f5a6402309c0 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:13.037196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 748/1505] 10.222.0.117 () {54 vars in 931 bytes} [Mon Jan 24 16:45:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:45:13.042928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd90be3-4374-4bd0-946f-fabe97fdb5e4 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:13.043347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd90be3-4374-4bd0-946f-fabe97fdb5e4 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:13.043487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd90be3-4374-4bd0-946f-fabe97fdb5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:13.061659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ffd90be3-4374-4bd0-946f-fabe97fdb5e4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:45:13.062884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ffd90be3-4374-4bd0-946f-fabe97fdb5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:45:13.070547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 758/1506] 10.222.0.117 () {58 vars in 1028 bytes} [Mon Jan 24 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:45:13.105723 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5960097-9dc8-4cdf-af06-f5a6402309c0 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:45:13.117859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5960097-9dc8-4cdf-af06-f5a6402309c0 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:45:13.122820 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ca1b-f847-449e-b134-2434c9c1993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:45:13.123649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ca1b-f847-449e-b134-2434c9c1993d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:13.123933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ca1b-f847-449e-b134-2434c9c1993d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:13.124212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ca1b-f847-449e-b134-2434c9c1993d admin admin] PATH_INFO: `/v3/projects/6e0f1fba09874be8ae22b37e033b5e57` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:13.125394 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ca1b-f847-449e-b134-2434c9c1993d admin admin] RBAC: Authorizing `identity:get_project(project_id=6e0f1fba09874be8ae22b37e033b5e57)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:45:13.127201 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ca1b-f847-449e-b134-2434c9c1993d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:45:13.128820 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 749/1507] 10.222.0.117 () {56 vars in 1212 bytes} [Mon Jan 24 16:45:13 2022] GET /identity/v3/projects/6e0f1fba09874be8ae22b37e033b5e57 => generated 345 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:45:13.140582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd90be3-4374-4bd0-946f-fabe97fdb5e4 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:45:13.149862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd90be3-4374-4bd0-946f-fabe97fdb5e4 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:45:13.153634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfd49a-218b-43b9-abdf-a660c4a1b85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:45:13.154275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfd49a-218b-43b9-abdf-a660c4a1b85e service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:45:13.154559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfd49a-218b-43b9-abdf-a660c4a1b85e service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:45:13.154891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfd49a-218b-43b9-abdf-a660c4a1b85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:45:13.163936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfd49a-218b-43b9-abdf-a660c4a1b85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:45:13.165347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfd49a-218b-43b9-abdf-a660c4a1b85e service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:45:13.174559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 759/1508] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:46:50.529167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff8db-f0c6-4ee9-a17e-8d2389d34620 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:50.529682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff8db-f0c6-4ee9-a17e-8d2389d34620 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:50.529789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff8db-f0c6-4ee9-a17e-8d2389d34620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:50.547703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-342ff8db-f0c6-4ee9-a17e-8d2389d34620 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:46:50.548879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-342ff8db-f0c6-4ee9-a17e-8d2389d34620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:46:50.557567 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 750/1509] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:46:50.566270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a82566-3d88-46c0-a37d-4ce43a5cd71f None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:50.566786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a82566-3d88-46c0-a37d-4ce43a5cd71f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:50.566900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a82566-3d88-46c0-a37d-4ce43a5cd71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:50.584705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d2a82566-3d88-46c0-a37d-4ce43a5cd71f None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:46:50.585883 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d2a82566-3d88-46c0-a37d-4ce43a5cd71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:46:50.593695 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 760/1510] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:46:50.598471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff8db-f0c6-4ee9-a17e-8d2389d34620 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:46:50.607857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff8db-f0c6-4ee9-a17e-8d2389d34620 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:46:50.613262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940720c-1583-4032-891c-2ab0ff309cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:46:50.613905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940720c-1583-4032-891c-2ab0ff309cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:50.614189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940720c-1583-4032-891c-2ab0ff309cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:50.614465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940720c-1583-4032-891c-2ab0ff309cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:50.615240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940720c-1583-4032-891c-2ab0ff309cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:46:50.615547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940720c-1583-4032-891c-2ab0ff309cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:46:50.617137 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940720c-1583-4032-891c-2ab0ff309cb4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:46:50.629319 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 751/1511] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:46:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:46:50.637178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a82566-3d88-46c0-a37d-4ce43a5cd71f None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:46:50.646053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a82566-3d88-46c0-a37d-4ce43a5cd71f None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:46:50.650639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca75d0-4ce9-4c00-8833-47d2122d58ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:46:50.651305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca75d0-4ce9-4c00-8833-47d2122d58ac admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:50.651591 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca75d0-4ce9-4c00-8833-47d2122d58ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:50.651870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca75d0-4ce9-4c00-8833-47d2122d58ac admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:50.652563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca75d0-4ce9-4c00-8833-47d2122d58ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:46:50.654459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca75d0-4ce9-4c00-8833-47d2122d58ac admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:46:50.691760 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 761/1512] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:46:50 2022] POST /identity/v3/projects => generated 380 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:46:50.695856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940720c-1583-4032-891c-2ab0ff309cb4 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:46:50.705796 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940720c-1583-4032-891c-2ab0ff309cb4 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:46:50.759338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacf7a4-ea14-47d8-9a6e-e44a7020bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:46:50.759926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacf7a4-ea14-47d8-9a6e-e44a7020bd3a admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:50.760217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacf7a4-ea14-47d8-9a6e-e44a7020bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:50.760489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacf7a4-ea14-47d8-9a6e-e44a7020bd3a admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:50.761199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacf7a4-ea14-47d8-9a6e-e44a7020bd3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:46:50.763143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacf7a4-ea14-47d8-9a6e-e44a7020bd3a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:46:50.781701 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 752/1513] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:46:50 2022] POST /identity/v3/users => generated 291 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:46:50.785678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca75d0-4ce9-4c00-8833-47d2122d58ac admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:46:50.795573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca75d0-4ce9-4c00-8833-47d2122d58ac admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:46:50.800604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d3141-2c64-4f10-9e21-96587fb200ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:46:50.801240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3141-2c64-4f10-9e21-96587fb200ba admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:50.801516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3141-2c64-4f10-9e21-96587fb200ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:50.801791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3141-2c64-4f10-9e21-96587fb200ba admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:50.802545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d3141-2c64-4f10-9e21-96587fb200ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:46:50.804158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d3141-2c64-4f10-9e21-96587fb200ba admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:46:50.817105 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 762/1514] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:46:50 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:46:50.821196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacf7a4-ea14-47d8-9a6e-e44a7020bd3a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:46:50.831220 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacf7a4-ea14-47d8-9a6e-e44a7020bd3a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:46:50.835706 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d56e51-9854-4902-be35-994dcdf1d059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:46:50.836487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56e51-9854-4902-be35-994dcdf1d059 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:50.836820 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56e51-9854-4902-be35-994dcdf1d059 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:50.837102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56e51-9854-4902-be35-994dcdf1d059 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:50.837837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d56e51-9854-4902-be35-994dcdf1d059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:46:50.839473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d56e51-9854-4902-be35-994dcdf1d059 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:46:50.852477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 753/1515] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:46:50 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:46:50.856491 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d3141-2c64-4f10-9e21-96587fb200ba admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:46:50.867166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d3141-2c64-4f10-9e21-96587fb200ba admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:46:50.871978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f6f37-7d91-4605-acd2-f91baf4d1f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:46:50.872838 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f6f37-7d91-4605-acd2-f91baf4d1f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:50.873125 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f6f37-7d91-4605-acd2-f91baf4d1f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:50.873411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f6f37-7d91-4605-acd2-f91baf4d1f8f admin admin] PATH_INFO: `/v3/projects/2f8ee00c8eb64951b1b23e050267b983/users/eae967dfa137426ea65e2269221ad7c0/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:50.888554 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f6f37-7d91-4605-acd2-f91baf4d1f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8ee00c8eb64951b1b23e050267b983, user_id=eae967dfa137426ea65e2269221ad7c0, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:46:50.891233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f6f37-7d91-4605-acd2-f91baf4d1f8f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:46:50.904276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 763/1516] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:46:50 2022] PUT /identity/v3/projects/2f8ee00c8eb64951b1b23e050267b983/users/eae967dfa137426ea65e2269221ad7c0/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:46:50.916318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34aab-4229-4633-ba7b-2be5bc5371d1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:50.916608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34aab-4229-4633-ba7b-2be5bc5371d1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:50.916887 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34aab-4229-4633-ba7b-2be5bc5371d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:50.945590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e7b34aab-4229-4633-ba7b-2be5bc5371d1 None None] MFA Rules not processed for user `eae967dfa137426ea65e2269221ad7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:46:50.946809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e7b34aab-4229-4633-ba7b-2be5bc5371d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:46:51.008190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 754/1517] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:46:51.019150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f6f37-7d91-4605-acd2-f91baf4d1f8f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:46:51.086803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f6f37-7d91-4605-acd2-f91baf4d1f8f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:46:51.092185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861b338-aeb0-49c3-a9aa-2edd24ec1a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:46:51.092814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861b338-aeb0-49c3-a9aa-2edd24ec1a8b service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:51.093103 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861b338-aeb0-49c3-a9aa-2edd24ec1a8b service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:51.093373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861b338-aeb0-49c3-a9aa-2edd24ec1a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:51.101559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861b338-aeb0-49c3-a9aa-2edd24ec1a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:46:51.103154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861b338-aeb0-49c3-a9aa-2edd24ec1a8b service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:46:51.112260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 764/1518] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:46:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:46:51.179953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbb235-8fd2-4ef7-b767-8c00d100ac5f None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:51.180238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbb235-8fd2-4ef7-b767-8c00d100ac5f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:51.180510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbb235-8fd2-4ef7-b767-8c00d100ac5f None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:51.182181 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 755/1519] 10.222.0.117 () {52 vars in 834 bytes} [Mon Jan 24 16:46:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:46:51.185701 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861b338-aeb0-49c3-a9aa-2edd24ec1a8b service nova] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:46:51.244697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861b338-aeb0-49c3-a9aa-2edd24ec1a8b service nova] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:46:51.249240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:46:51.250089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:51.250367 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:51.250639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] PATH_INFO: `/v3/users/eae967dfa137426ea65e2269221ad7c0` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:51.251851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae967dfa137426ea65e2269221ad7c0)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:46:51.253165 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:46:51.253165 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:46:51.253165 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:46:51.254361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:46:51.314869 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae967dfa137426ea65e2269221ad7c0'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:46:51.334668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae967dfa137426ea65e2269221ad7c0'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:46:51.335475 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae967dfa137426ea65e2269221ad7c0'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:46:51.336083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae967dfa137426ea65e2269221ad7c0'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:46:51.344193 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae967dfa137426ea65e2269221ad7c0'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:46:51.361792 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 765/1520] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:46:51 2022] DELETE /identity/v3/users/eae967dfa137426ea65e2269221ad7c0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:46:51.366147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb305f-a40d-4021-816d-4befef3a3412 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:51.366429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb305f-a40d-4021-816d-4befef3a3412 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:51.366698 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb305f-a40d-4021-816d-4befef3a3412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:51.383703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d1cb305f-a40d-4021-816d-4befef3a3412 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:46:51.384896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d1cb305f-a40d-4021-816d-4befef3a3412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:46:51.441101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 756/1521] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:46:51.451896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:46:51.453631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:46:51.509458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25b77d-770d-4f86-bd8d-324615c103f2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:46:51.512962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b13e4-74ae-4d9a-b9bc-24e82760da9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:46:51.513588 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b13e4-74ae-4d9a-b9bc-24e82760da9e service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:51.513891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b13e4-74ae-4d9a-b9bc-24e82760da9e service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:51.514162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b13e4-74ae-4d9a-b9bc-24e82760da9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:51.523371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b13e4-74ae-4d9a-b9bc-24e82760da9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:46:51.524810 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b13e4-74ae-4d9a-b9bc-24e82760da9e service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:46:51.534472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 766/1522] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:46:51.955494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb305f-a40d-4021-816d-4befef3a3412 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:46:51.956933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d1cb305f-a40d-4021-816d-4befef3a3412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:46:51.968457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb305f-a40d-4021-816d-4befef3a3412 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:46:51.973652 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:46:51.974496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:46:51.974809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:46:51.975090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] PATH_INFO: `/v3/projects/2f8ee00c8eb64951b1b23e050267b983` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:46:51.976308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8ee00c8eb64951b1b23e050267b983)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:46:51.977346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:46:51.977346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:46:51.977346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:46:51.978547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:46:52.038358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8ee00c8eb64951b1b23e050267b983', 'request_id': 'req-7c8b86bc-a575-42a9-b26e-06296d70ebc6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:46:52.047943 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8ee00c8eb64951b1b23e050267b983', 'request_id': 'req-7c8b86bc-a575-42a9-b26e-06296d70ebc6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:46:52.061671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8ee00c8eb64951b1b23e050267b983', 'request_id': 'req-7c8b86bc-a575-42a9-b26e-06296d70ebc6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:46:52.072437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] The token cache is being invalidate because project 2f8ee00c8eb64951b1b23e050267b983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:46:52.072723 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:46:52.073477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7c8b86bc-a575-42a9-b26e-06296d70ebc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:46:52.075037 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 757/1523] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:46:51 2022] DELETE /identity/v3/projects/2f8ee00c8eb64951b1b23e050267b983 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:48:25.241565 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0faa77-7ef0-4a58-9cb9-e053b898ca82 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:25.242173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0faa77-7ef0-4a58-9cb9-e053b898ca82 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:25.242173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0faa77-7ef0-4a58-9cb9-e053b898ca82 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:25.244019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 767/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:48:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:48:25.249086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae211c-7f2e-40ea-8a32-7e42219e5493 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:25.249512 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae211c-7f2e-40ea-8a32-7e42219e5493 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:25.249642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae211c-7f2e-40ea-8a32-7e42219e5493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:25.270373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-00ae211c-7f2e-40ea-8a32-7e42219e5493 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:48:25.271646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-00ae211c-7f2e-40ea-8a32-7e42219e5493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:25.330513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 758/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:48:25.485326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0faa77-7ef0-4a58-9cb9-e053b898ca82 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:48:25.487300 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7e0faa77-7ef0-4a58-9cb9-e053b898ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:25.565429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0faa77-7ef0-4a58-9cb9-e053b898ca82 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:48:25.570712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e711e-a4b6-4404-b5e7-24bd123cba44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:48:25.571371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e711e-a4b6-4404-b5e7-24bd123cba44 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:25.571646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e711e-a4b6-4404-b5e7-24bd123cba44 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:25.571915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e711e-a4b6-4404-b5e7-24bd123cba44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:25.580058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e711e-a4b6-4404-b5e7-24bd123cba44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:48:25.581621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e711e-a4b6-4404-b5e7-24bd123cba44 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:48:25.590586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 768/1526] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:48:25.993475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3ddb8-c359-41f7-8cd3-d53d0c389d36 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:25.993955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3ddb8-c359-41f7-8cd3-d53d0c389d36 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:25.994323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3ddb8-c359-41f7-8cd3-d53d0c389d36 None None] PATH_INFO: `/v3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:25.995766 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 759/1527] 10.222.0.79 () {54 vars in 929 bytes} [Mon Jan 24 16:48:25 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:48:26.005169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f1b9-0b10-42db-8a95-fd2cc6b7e266 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:26.005456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f1b9-0b10-42db-8a95-fd2cc6b7e266 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:26.005738 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f1b9-0b10-42db-8a95-fd2cc6b7e266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:26.023773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a259f1b9-0b10-42db-8a95-fd2cc6b7e266 None None] MFA Rules not processed for user `15975bd016ed48f9bf5c88845180ebf0`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:48:26.024942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a259f1b9-0b10-42db-8a95-fd2cc6b7e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:26.086589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 769/1528] 10.222.0.79 () {58 vars in 1019 bytes} [Mon Jan 24 16:48:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:48:26.887083 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb17f5-4286-43a7-b4f1-b0a63db5a5a3 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:26.887646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb17f5-4286-43a7-b4f1-b0a63db5a5a3 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:26.887646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb17f5-4286-43a7-b4f1-b0a63db5a5a3 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:26.889448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 760/1529] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:48:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:48:26.894566 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ef839-2a81-4f72-8db0-2c0f390a57ac None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:26.895006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ef839-2a81-4f72-8db0-2c0f390a57ac None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:26.895198 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ef839-2a81-4f72-8db0-2c0f390a57ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:26.913039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-174ef839-2a81-4f72-8db0-2c0f390a57ac None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:48:26.914226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-174ef839-2a81-4f72-8db0-2c0f390a57ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:26.922629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 770/1530] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:48:27.078585 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb17f5-4286-43a7-b4f1-b0a63db5a5a3 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:48:27.092743 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb17f5-4286-43a7-b4f1-b0a63db5a5a3 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:48:27.098428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e4bd6-1dce-41c6-b95a-b9bc82273228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:48:27.099095 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4bd6-1dce-41c6-b95a-b9bc82273228 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:27.099380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4bd6-1dce-41c6-b95a-b9bc82273228 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:27.099658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4bd6-1dce-41c6-b95a-b9bc82273228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:27.107712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e4bd6-1dce-41c6-b95a-b9bc82273228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:48:27.110072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e4bd6-1dce-41c6-b95a-b9bc82273228 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:48:27.119439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 761/1531] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:48:30.163635 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963abf4c-0417-461e-b422-c53bad5038f6 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:30.164136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963abf4c-0417-461e-b422-c53bad5038f6 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:30.164332 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963abf4c-0417-461e-b422-c53bad5038f6 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:30.165992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 771/1532] 10.222.0.117 () {54 vars in 965 bytes} [Mon Jan 24 16:48:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:48:30.172801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa20e64-e7c8-475d-b0ca-698a29cb14c2 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:30.173215 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa20e64-e7c8-475d-b0ca-698a29cb14c2 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:30.173433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa20e64-e7c8-475d-b0ca-698a29cb14c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:30.191656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-8fa20e64-e7c8-475d-b0ca-698a29cb14c2 None None] MFA Rules not processed for user `15975bd016ed48f9bf5c88845180ebf0`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:48:30.192842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8fa20e64-e7c8-475d-b0ca-698a29cb14c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:30.201494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 762/1533] 10.222.0.117 () {58 vars in 1062 bytes} [Mon Jan 24 16:48:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:48:30.208753 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963abf4c-0417-461e-b422-c53bad5038f6 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:48:30.221837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963abf4c-0417-461e-b422-c53bad5038f6 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:48:30.226783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1781cf-1baf-417d-85cf-285cce56b0d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15975bd016ed48f9bf5c88845180ebf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:48:30.227411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1781cf-1baf-417d-85cf-285cce56b0d9 service placement] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:30.227694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1781cf-1baf-417d-85cf-285cce56b0d9 service placement] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:30.227971 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1781cf-1baf-417d-85cf-285cce56b0d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:30.236639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1781cf-1baf-417d-85cf-285cce56b0d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:48:30.238244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1781cf-1baf-417d-85cf-285cce56b0d9 service placement] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:48:30.247743 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 772/1534] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:48:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:48:38.858154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255bb91-3f17-4d7c-b101-6b753edf98b6 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:38.858681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255bb91-3f17-4d7c-b101-6b753edf98b6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:38.858681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255bb91-3f17-4d7c-b101-6b753edf98b6 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:38.860501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 763/1535] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:48:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:48:38.865422 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbf2b5-ec7b-4574-aa9d-f4d2c3f061b0 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:38.865876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbf2b5-ec7b-4574-aa9d-f4d2c3f061b0 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:38.865980 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbf2b5-ec7b-4574-aa9d-f4d2c3f061b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:38.884216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b0dbf2b5-ec7b-4574-aa9d-f4d2c3f061b0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:48:38.885399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b0dbf2b5-ec7b-4574-aa9d-f4d2c3f061b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:38.894626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 773/1536] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:48:39.049231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255bb91-3f17-4d7c-b101-6b753edf98b6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:48:39.064140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255bb91-3f17-4d7c-b101-6b753edf98b6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:48:39.069468 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa13ca-aafe-470d-bbdd-d5d3a342713d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:48:39.070083 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa13ca-aafe-470d-bbdd-d5d3a342713d service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:39.070363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa13ca-aafe-470d-bbdd-d5d3a342713d service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:39.070634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa13ca-aafe-470d-bbdd-d5d3a342713d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:39.079578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa13ca-aafe-470d-bbdd-d5d3a342713d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:48:39.081223 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa13ca-aafe-470d-bbdd-d5d3a342713d service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:48:39.090620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 764/1537] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:48:40.375831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237bb13-603a-4101-8eba-a5c4a20f05a9 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:40.376399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237bb13-603a-4101-8eba-a5c4a20f05a9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:40.376399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237bb13-603a-4101-8eba-a5c4a20f05a9 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:40.378228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 774/1538] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 24 16:48:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:48:40.383062 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50c054-b8fc-406f-a079-a2c2cf8b4dcb None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:40.383487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50c054-b8fc-406f-a079-a2c2cf8b4dcb None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:40.383607 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50c054-b8fc-406f-a079-a2c2cf8b4dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:40.401605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-5b50c054-b8fc-406f-a079-a2c2cf8b4dcb None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:48:40.402807 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5b50c054-b8fc-406f-a079-a2c2cf8b4dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:40.410652 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 765/1539] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 24 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:48:40.563866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237bb13-603a-4101-8eba-a5c4a20f05a9 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:48:40.579408 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237bb13-603a-4101-8eba-a5c4a20f05a9 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:48:40.584882 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acc0cf-1ebf-43ab-8051-c8b50ecd743e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:48:40.585512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc0cf-1ebf-43ab-8051-c8b50ecd743e service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:40.585796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc0cf-1ebf-43ab-8051-c8b50ecd743e service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:40.586075 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc0cf-1ebf-43ab-8051-c8b50ecd743e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:40.594327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acc0cf-1ebf-43ab-8051-c8b50ecd743e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:48:40.595943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acc0cf-1ebf-43ab-8051-c8b50ecd743e service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:48:40.605143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 775/1540] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:48:44.830220 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76a3bc-83d5-43fd-8036-334b1401a529 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:44.830786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76a3bc-83d5-43fd-8036-334b1401a529 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:44.830786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76a3bc-83d5-43fd-8036-334b1401a529 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:44.832494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 766/1541] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:48:44 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:48:44.837762 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8453fa-2b4c-4315-a7c0-45d30f600a62 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:44.838179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8453fa-2b4c-4315-a7c0-45d30f600a62 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:44.838313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8453fa-2b4c-4315-a7c0-45d30f600a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:44.856749 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-1e8453fa-2b4c-4315-a7c0-45d30f600a62 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:48:44.857918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1e8453fa-2b4c-4315-a7c0-45d30f600a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:44.865631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 776/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:48:44.903625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76a3bc-83d5-43fd-8036-334b1401a529 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:48:44.905313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-fe76a3bc-83d5-43fd-8036-334b1401a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:44.965190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76a3bc-83d5-43fd-8036-334b1401a529 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:48:44.968885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c3ef5-7a65-443f-8e1f-c402552876ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:48:44.969524 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3ef5-7a65-443f-8e1f-c402552876ec service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:44.969809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3ef5-7a65-443f-8e1f-c402552876ec service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:44.970089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3ef5-7a65-443f-8e1f-c402552876ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:44.979222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c3ef5-7a65-443f-8e1f-c402552876ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:48:44.980679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c3ef5-7a65-443f-8e1f-c402552876ec service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:48:44.991801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 767/1543] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:48:47.198058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2d670-1139-4742-a418-7ba06455a931 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:47.198609 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2d670-1139-4742-a418-7ba06455a931 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:47.198609 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2d670-1139-4742-a418-7ba06455a931 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:47.200402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 777/1544] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:48:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:48:47.206085 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1433d9-0f6c-4c1e-b5e3-ebfef2ecc4fc None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:47.206503 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1433d9-0f6c-4c1e-b5e3-ebfef2ecc4fc None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:47.206643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1433d9-0f6c-4c1e-b5e3-ebfef2ecc4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:47.224595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-1b1433d9-0f6c-4c1e-b5e3-ebfef2ecc4fc None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:48:47.225772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1b1433d9-0f6c-4c1e-b5e3-ebfef2ecc4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:47.233450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 768/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:48:47.270248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2d670-1139-4742-a418-7ba06455a931 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:48:47.281211 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2d670-1139-4742-a418-7ba06455a931 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:48:47.284795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cc272-d262-4dbc-9d71-711abd335cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:48:47.285456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cc272-d262-4dbc-9d71-711abd335cdc service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:47.285735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cc272-d262-4dbc-9d71-711abd335cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:47.286006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cc272-d262-4dbc-9d71-711abd335cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:47.294840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cc272-d262-4dbc-9d71-711abd335cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:48:47.296364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cc272-d262-4dbc-9d71-711abd335cdc service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:48:47.305803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 778/1546] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:48:51.109732 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2420db-bb66-4c40-a613-dc9cf5c61f4a None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:51.110289 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2420db-bb66-4c40-a613-dc9cf5c61f4a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:51.110289 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2420db-bb66-4c40-a613-dc9cf5c61f4a None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:51.112136 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 769/1547] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:48:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:48:51.117389 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ac192-032a-40bc-8919-170e2a91065b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:51.117815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ac192-032a-40bc-8919-170e2a91065b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:51.117941 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ac192-032a-40bc-8919-170e2a91065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:51.135928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d17ac192-032a-40bc-8919-170e2a91065b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:48:51.137110 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d17ac192-032a-40bc-8919-170e2a91065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:51.145023 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 779/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:48:51.412914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2420db-bb66-4c40-a613-dc9cf5c61f4a None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:48:51.414514 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-2d2420db-bb66-4c40-a613-dc9cf5c61f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:51.485272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2420db-bb66-4c40-a613-dc9cf5c61f4a None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:48:51.489161 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9454a-3a73-4dd4-af31-be4773fdbd07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:48:51.489925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9454a-3a73-4dd4-af31-be4773fdbd07 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:51.490204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9454a-3a73-4dd4-af31-be4773fdbd07 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:51.490476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9454a-3a73-4dd4-af31-be4773fdbd07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:51.499280 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9454a-3a73-4dd4-af31-be4773fdbd07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:48:51.500877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9454a-3a73-4dd4-af31-be4773fdbd07 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:48:51.509888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 770/1549] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:48:53.820725 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abf324-1bcf-4080-bd03-275be6af039f None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:53.821333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abf324-1bcf-4080-bd03-275be6af039f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:53.821333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abf324-1bcf-4080-bd03-275be6af039f None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:53.823340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 780/1550] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 24 16:48:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:48:53.829702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc437c-583e-4eb5-9c75-3ad44c85543b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:53.830140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc437c-583e-4eb5-9c75-3ad44c85543b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:53.830244 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc437c-583e-4eb5-9c75-3ad44c85543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:53.848527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-06cc437c-583e-4eb5-9c75-3ad44c85543b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:48:53.849724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-06cc437c-583e-4eb5-9c75-3ad44c85543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:53.857811 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 771/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 24 16:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:48:54.131219 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92589fb3-a5d5-4556-8ceb-2cd4d0ac75fe None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:54.131406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92589fb3-a5d5-4556-8ceb-2cd4d0ac75fe None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:54.131689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92589fb3-a5d5-4556-8ceb-2cd4d0ac75fe None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:54.133514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 781/1552] 10.222.0.117 () {54 vars in 968 bytes} [Mon Jan 24 16:48:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:48:54.138575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ff1c1-3f42-4325-8fac-60668fbbae98 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:54.138907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ff1c1-3f42-4325-8fac-60668fbbae98 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:54.139194 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ff1c1-3f42-4325-8fac-60668fbbae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:54.158354 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7a3ff1c1-3f42-4325-8fac-60668fbbae98 None None] MFA Rules not processed for user `3c62250938c543d788dd7fd690b5abad`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:48:54.159324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7a3ff1c1-3f42-4325-8fac-60668fbbae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:48:54.165861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 772/1553] 10.222.0.117 () {58 vars in 1065 bytes} [Mon Jan 24 16:48:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:48:54.174064 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92589fb3-a5d5-4556-8ceb-2cd4d0ac75fe None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:48:54.184491 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92589fb3-a5d5-4556-8ceb-2cd4d0ac75fe None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:48:54.188181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b057f5-6907-4c28-aaac-e61c07f7406d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:48:54.188806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b057f5-6907-4c28-aaac-e61c07f7406d service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:48:54.189089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b057f5-6907-4c28-aaac-e61c07f7406d service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:48:54.189362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b057f5-6907-4c28-aaac-e61c07f7406d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:48:54.198370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b057f5-6907-4c28-aaac-e61c07f7406d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:48:54.199833 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b057f5-6907-4c28-aaac-e61c07f7406d service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:48:54.209818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 782/1554] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:16.843500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0efa-8319-46e9-9dc3-9486f66087bb None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:16.848231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0efa-8319-46e9-9dc3-9486f66087bb None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:16.848231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0efa-8319-46e9-9dc3-9486f66087bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:16.866970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e7df0efa-8319-46e9-9dc3-9486f66087bb None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:16.868178 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e7df0efa-8319-46e9-9dc3-9486f66087bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:16.882064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 773/1555] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:16.891182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3402-8df7-44f8-b47a-4a48a4b2f788 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:16.892166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3402-8df7-44f8-b47a-4a48a4b2f788 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:16.892663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3402-8df7-44f8-b47a-4a48a4b2f788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:16.919401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-eb2e3402-8df7-44f8-b47a-4a48a4b2f788 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:16.920684 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-eb2e3402-8df7-44f8-b47a-4a48a4b2f788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:16.937195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 783/1556] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:16.941581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df0efa-8319-46e9-9dc3-9486f66087bb None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:16.956972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df0efa-8319-46e9-9dc3-9486f66087bb None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:16.961975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8948c-a5cb-4654-9075-bbd8c260a2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:16.962645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8948c-a5cb-4654-9075-bbd8c260a2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:16.962968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8948c-a5cb-4654-9075-bbd8c260a2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:16.963247 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8948c-a5cb-4654-9075-bbd8c260a2d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:16.964031 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8948c-a5cb-4654-9075-bbd8c260a2d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:16.964336 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8948c-a5cb-4654-9075-bbd8c260a2d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:16.966204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8948c-a5cb-4654-9075-bbd8c260a2d0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:16.984085 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 774/1557] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:16.992345 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e3402-8df7-44f8-b47a-4a48a4b2f788 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:17.007309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e3402-8df7-44f8-b47a-4a48a4b2f788 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:17.016749 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7dbe9-bd45-40a0-9728-dc7fdf6edca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:17.017416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7dbe9-bd45-40a0-9728-dc7fdf6edca7 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.017701 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7dbe9-bd45-40a0-9728-dc7fdf6edca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.017977 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7dbe9-bd45-40a0-9728-dc7fdf6edca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.018697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7dbe9-bd45-40a0-9728-dc7fdf6edca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:17.020875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7dbe9-bd45-40a0-9728-dc7fdf6edca7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:17.060184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 784/1558] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:16 2022] POST /identity/v3/projects => generated 390 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:17.063924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8948c-a5cb-4654-9075-bbd8c260a2d0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:17.078633 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8948c-a5cb-4654-9075-bbd8c260a2d0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:17.168045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce369d-6b45-4468-acf6-d841e7f5039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:17.168728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce369d-6b45-4468-acf6-d841e7f5039a admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.169011 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce369d-6b45-4468-acf6-d841e7f5039a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.169286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce369d-6b45-4468-acf6-d841e7f5039a admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.170133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce369d-6b45-4468-acf6-d841e7f5039a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:17.172109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce369d-6b45-4468-acf6-d841e7f5039a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:17.204977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 775/1559] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:17.209692 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7dbe9-bd45-40a0-9728-dc7fdf6edca7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:17.226793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7dbe9-bd45-40a0-9728-dc7fdf6edca7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:17.237993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7869f-d0de-46ce-a415-e93a559e1654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:17.238666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7869f-d0de-46ce-a415-e93a559e1654 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.239145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7869f-d0de-46ce-a415-e93a559e1654 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.239583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7869f-d0de-46ce-a415-e93a559e1654 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.240468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7869f-d0de-46ce-a415-e93a559e1654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:17.242094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7869f-d0de-46ce-a415-e93a559e1654 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:17.258427 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 785/1560] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:17 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:17.262972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce369d-6b45-4468-acf6-d841e7f5039a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:17.276388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce369d-6b45-4468-acf6-d841e7f5039a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:17.283474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0813646-c80a-43cf-9dff-f3d11503d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:17.284150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0813646-c80a-43cf-9dff-f3d11503d032 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.284431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0813646-c80a-43cf-9dff-f3d11503d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.284710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0813646-c80a-43cf-9dff-f3d11503d032 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.285458 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0813646-c80a-43cf-9dff-f3d11503d032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:17.287093 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0813646-c80a-43cf-9dff-f3d11503d032 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:17.300860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 776/1561] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:17 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:17.305258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7869f-d0de-46ce-a415-e93a559e1654 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:17.319847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7869f-d0de-46ce-a415-e93a559e1654 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:17.325444 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3459-9502-4764-8dca-b9299ea0316b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.325739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3459-9502-4764-8dca-b9299ea0316b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.326022 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3459-9502-4764-8dca-b9299ea0316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.329503 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa974d-1ac4-440d-8d3d-ffcf618a51a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:17.330480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa974d-1ac4-440d-8d3d-ffcf618a51a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.330788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa974d-1ac4-440d-8d3d-ffcf618a51a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.331066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa974d-1ac4-440d-8d3d-ffcf618a51a0 admin admin] PATH_INFO: `/v3/projects/5ca1c94bee974fb986196c0be4064812/users/50e012c5fcde4462984a57878629fd6f/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.354350 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-98ec3459-9502-4764-8dca-b9299ea0316b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:17.355951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-98ec3459-9502-4764-8dca-b9299ea0316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:17.356283 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa974d-1ac4-440d-8d3d-ffcf618a51a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca1c94bee974fb986196c0be4064812, user_id=50e012c5fcde4462984a57878629fd6f, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:17.358980 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa974d-1ac4-440d-8d3d-ffcf618a51a0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:17.374966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 777/1562] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jan 24 16:50:17.384050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91727ce3-aa29-49c3-bd1b-05a8c192d428 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.384349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91727ce3-aa29-49c3-bd1b-05a8c192d428 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.384761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91727ce3-aa29-49c3-bd1b-05a8c192d428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.392579 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 786/1563] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:17 2022] PUT /identity/v3/projects/5ca1c94bee974fb986196c0be4064812/users/50e012c5fcde4462984a57878629fd6f/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:17.409157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86e486-76f9-4002-8c32-542f263eda2e None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.409157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86e486-76f9-4002-8c32-542f263eda2e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.409157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86e486-76f9-4002-8c32-542f263eda2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.413917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-91727ce3-aa29-49c3-bd1b-05a8c192d428 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:17.415169 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-91727ce3-aa29-49c3-bd1b-05a8c192d428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:17.438437 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-2f86e486-76f9-4002-8c32-542f263eda2e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:17.439834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2f86e486-76f9-4002-8c32-542f263eda2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:17.528616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 778/1564] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:17.533187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91727ce3-aa29-49c3-bd1b-05a8c192d428 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:17.542386 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 787/1565] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:17.548310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91727ce3-aa29-49c3-bd1b-05a8c192d428 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:17.560679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14923131-7561-42b3-a259-68eaf8be98df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:17.560679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923131-7561-42b3-a259-68eaf8be98df admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.560679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923131-7561-42b3-a259-68eaf8be98df admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.560679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923131-7561-42b3-a259-68eaf8be98df admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.561172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14923131-7561-42b3-a259-68eaf8be98df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:17.561172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14923131-7561-42b3-a259-68eaf8be98df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:17.562574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14923131-7561-42b3-a259-68eaf8be98df admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:17.564255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86e486-76f9-4002-8c32-542f263eda2e None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:17.582507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 779/1566] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:17.591509 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14923131-7561-42b3-a259-68eaf8be98df admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:17.609421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14923131-7561-42b3-a259-68eaf8be98df admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:17.620754 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526ad54-ad59-44fc-9000-66bd68cfb603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:17.621846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526ad54-ad59-44fc-9000-66bd68cfb603 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.621846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526ad54-ad59-44fc-9000-66bd68cfb603 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.622128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526ad54-ad59-44fc-9000-66bd68cfb603 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.622872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526ad54-ad59-44fc-9000-66bd68cfb603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:17.625111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526ad54-ad59-44fc-9000-66bd68cfb603 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:17.679510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86e486-76f9-4002-8c32-542f263eda2e None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:17.685417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f21ee-26cd-46f9-adeb-d36b8f422a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:17.685866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 780/1567] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/projects => generated 374 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:50:17.686109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f21ee-26cd-46f9-adeb-d36b8f422a9c service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.686342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f21ee-26cd-46f9-adeb-d36b8f422a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.686619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f21ee-26cd-46f9-adeb-d36b8f422a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.689163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281882e-f077-4cbb-bd3c-4ae3c19406be None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.689451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281882e-f077-4cbb-bd3c-4ae3c19406be None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.689728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281882e-f077-4cbb-bd3c-4ae3c19406be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.715323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f21ee-26cd-46f9-adeb-d36b8f422a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:17.716767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f21ee-26cd-46f9-adeb-d36b8f422a9c service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:17.727711 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 788/1568] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:17.729203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e368-d600-47d8-8d84-4c8945c4a1bb None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.729331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-f281882e-f077-4cbb-bd3c-4ae3c19406be None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:17.730235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e368-d600-47d8-8d84-4c8945c4a1bb None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.730525 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e368-d600-47d8-8d84-4c8945c4a1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.731109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f281882e-f077-4cbb-bd3c-4ae3c19406be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:17.756002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-fcd5e368-d600-47d8-8d84-4c8945c4a1bb None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:17.757523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-fcd5e368-d600-47d8-8d84-4c8945c4a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:17.840810 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 781/1569] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:17.841726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281882e-f077-4cbb-bd3c-4ae3c19406be None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:17.852134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281882e-f077-4cbb-bd3c-4ae3c19406be None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:17.853428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 789/1570] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:17.857913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fba84-7611-4613-8c17-6ed6dbbdd27e None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.858700 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db3aab-3062-4c1f-a925-e9bae19f4624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:17.859340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fba84-7611-4613-8c17-6ed6dbbdd27e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.859530 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3aab-3062-4c1f-a925-e9bae19f4624 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.860095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fba84-7611-4613-8c17-6ed6dbbdd27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.860333 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3aab-3062-4c1f-a925-e9bae19f4624 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.861041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3aab-3062-4c1f-a925-e9bae19f4624 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.862090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db3aab-3062-4c1f-a925-e9bae19f4624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:17.864840 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db3aab-3062-4c1f-a925-e9bae19f4624 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:17.881552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a23fba84-7611-4613-8c17-6ed6dbbdd27e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:17.882778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a23fba84-7611-4613-8c17-6ed6dbbdd27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:17.890088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 782/1571] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:17.890088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1627-6ea2-4456-9c13-927c69b1cb5d None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.890088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1627-6ea2-4456-9c13-927c69b1cb5d None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.890088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1627-6ea2-4456-9c13-927c69b1cb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.900200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 790/1572] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:17.904466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dbf46-5a80-443c-bedd-f66da522aec1 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.904751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dbf46-5a80-443c-bedd-f66da522aec1 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.905020 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dbf46-5a80-443c-bedd-f66da522aec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.912099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-22ca1627-6ea2-4456-9c13-927c69b1cb5d None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:17.914073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-22ca1627-6ea2-4456-9c13-927c69b1cb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:17.925213 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 783/1573] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:17.926783 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8989-6810-4859-b894-095ac05f727d None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.927496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8989-6810-4859-b894-095ac05f727d None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.927496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8989-6810-4859-b894-095ac05f727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.945328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-3a4dbf46-5a80-443c-bedd-f66da522aec1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:17.946731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3a4dbf46-5a80-443c-bedd-f66da522aec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:17.950104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-500d8989-6810-4859-b894-095ac05f727d None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:17.952514 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-500d8989-6810-4859-b894-095ac05f727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:17.959177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 791/1574] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:17.960461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2523-1b64-41c8-844e-a31abcff16da None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.960784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2523-1b64-41c8-844e-a31abcff16da None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.961117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2523-1b64-41c8-844e-a31abcff16da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.971074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 784/1575] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:17.972389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe48b1-c48b-4044-bb64-8405dcfbde1a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:17.972683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe48b1-c48b-4044-bb64-8405dcfbde1a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:17.972965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe48b1-c48b-4044-bb64-8405dcfbde1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:17.987840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-407b2523-1b64-41c8-844e-a31abcff16da None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:17.989347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-407b2523-1b64-41c8-844e-a31abcff16da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:17.992739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-5cbe48b1-c48b-4044-bb64-8405dcfbde1a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:17.994197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5cbe48b1-c48b-4044-bb64-8405dcfbde1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:17.999443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 792/1576] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:18.003220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b2523-1b64-41c8-844e-a31abcff16da None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.004846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 785/1577] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:18.006282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f7f94-e36c-4067-832b-29c336466f81 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.006645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f7f94-e36c-4067-832b-29c336466f81 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.007026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f7f94-e36c-4067-832b-29c336466f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.014261 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b2523-1b64-41c8-844e-a31abcff16da None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.019658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2006c-c3a4-4aa0-88e2-8b5528fb4e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.020513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2006c-c3a4-4aa0-88e2-8b5528fb4e82 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.020639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2006c-c3a4-4aa0-88e2-8b5528fb4e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.020864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2006c-c3a4-4aa0-88e2-8b5528fb4e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.021611 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2006c-c3a4-4aa0-88e2-8b5528fb4e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.023270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2006c-c3a4-4aa0-88e2-8b5528fb4e82 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.026341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7c2f7f94-e36c-4067-832b-29c336466f81 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:18.028662 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7c2f7f94-e36c-4067-832b-29c336466f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:18.035383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 793/1578] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:17 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:18.036538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f242-4537-4303-9443-f5ab2c8b56f9 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.036836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f242-4537-4303-9443-f5ab2c8b56f9 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.037310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f242-4537-4303-9443-f5ab2c8b56f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.037448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 786/1579] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:18.038966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98c9c-6c13-4ef3-a733-6a94f3570df9 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.039263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98c9c-6c13-4ef3-a733-6a94f3570df9 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.039543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98c9c-6c13-4ef3-a733-6a94f3570df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.057979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-fcd98c9c-6c13-4ef3-a733-6a94f3570df9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:18.059221 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-fcd98c9c-6c13-4ef3-a733-6a94f3570df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:18.065656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ca22f242-4537-4303-9443-f5ab2c8b56f9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:18.067078 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ca22f242-4537-4303-9443-f5ab2c8b56f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:18.067688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 787/1580] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:18.069271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbc873-fd30-447b-8e9a-669dae487ec6 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.069556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbc873-fd30-447b-8e9a-669dae487ec6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.069835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbc873-fd30-447b-8e9a-669dae487ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.081723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 794/1581] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:18.082987 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22f242-4537-4303-9443-f5ab2c8b56f9 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.093224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-f6cbc873-fd30-447b-8e9a-669dae487ec6 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:18.095031 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f6cbc873-fd30-447b-8e9a-669dae487ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:18.095405 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22f242-4537-4303-9443-f5ab2c8b56f9 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.104439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba88be3-726a-4f51-a389-67a0512c5ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.107284 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba88be3-726a-4f51-a389-67a0512c5ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.108493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba88be3-726a-4f51-a389-67a0512c5ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.109164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba88be3-726a-4f51-a389-67a0512c5ea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.111017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba88be3-726a-4f51-a389-67a0512c5ea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:18.111563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba88be3-726a-4f51-a389-67a0512c5ea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.113242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 788/1582] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:18.114171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba88be3-726a-4f51-a389-67a0512c5ea6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.114676 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbc873-fd30-447b-8e9a-669dae487ec6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.127997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbc873-fd30-447b-8e9a-669dae487ec6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.129285 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 795/1583] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:18.130860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba88be3-726a-4f51-a389-67a0512c5ea6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.133944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225ae9c-7eb1-42c4-a684-2af8170977f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.134619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225ae9c-7eb1-42c4-a684-2af8170977f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.134930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225ae9c-7eb1-42c4-a684-2af8170977f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.135211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225ae9c-7eb1-42c4-a684-2af8170977f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.136772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225ae9c-7eb1-42c4-a684-2af8170977f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:18.137619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225ae9c-7eb1-42c4-a684-2af8170977f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.141676 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225ae9c-7eb1-42c4-a684-2af8170977f7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.145256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba88be3-726a-4f51-a389-67a0512c5ea6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.156069 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 789/1584] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:18.156220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0239be-4f69-4ce2-9a53-b879c52715c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.156674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0239be-4f69-4ce2-9a53-b879c52715c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.156954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0239be-4f69-4ce2-9a53-b879c52715c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.157226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0239be-4f69-4ce2-9a53-b879c52715c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.158641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0239be-4f69-4ce2-9a53-b879c52715c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:18.158641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0239be-4f69-4ce2-9a53-b879c52715c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.160083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0239be-4f69-4ce2-9a53-b879c52715c6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.163827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225ae9c-7eb1-42c4-a684-2af8170977f7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.174087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 796/1585] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:18.175086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0239be-4f69-4ce2-9a53-b879c52715c6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.181535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225ae9c-7eb1-42c4-a684-2af8170977f7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.187808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44beb8b4-e525-4ec4-8c42-7508050197fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.187996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb8b4-e525-4ec4-8c42-7508050197fa admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.188249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb8b4-e525-4ec4-8c42-7508050197fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.188533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb8b4-e525-4ec4-8c42-7508050197fa admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.189278 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44beb8b4-e525-4ec4-8c42-7508050197fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.191578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44beb8b4-e525-4ec4-8c42-7508050197fa admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.192395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0239be-4f69-4ce2-9a53-b879c52715c6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.198983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1df5-b399-40d6-b8a8-ea25ccbf522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.200059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1df5-b399-40d6-b8a8-ea25ccbf522e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.200596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1df5-b399-40d6-b8a8-ea25ccbf522e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.200872 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1df5-b399-40d6-b8a8-ea25ccbf522e admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.201614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b1df5-b399-40d6-b8a8-ea25ccbf522e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:18.201922 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b1df5-b399-40d6-b8a8-ea25ccbf522e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.203703 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b1df5-b399-40d6-b8a8-ea25ccbf522e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.204664 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 790/1586] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:18 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:18.205627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44beb8b4-e525-4ec4-8c42-7508050197fa admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.218340 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44beb8b4-e525-4ec4-8c42-7508050197fa admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.221748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 797/1587] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:18.222785 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1df5-b399-40d6-b8a8-ea25ccbf522e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.229184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d329f5-da2f-4ee9-86b6-73f2c4676b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.230263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d329f5-da2f-4ee9-86b6-73f2c4676b9b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.230934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d329f5-da2f-4ee9-86b6-73f2c4676b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.231189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d329f5-da2f-4ee9-86b6-73f2c4676b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.231929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d329f5-da2f-4ee9-86b6-73f2c4676b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:18.232370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d329f5-da2f-4ee9-86b6-73f2c4676b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.233315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1df5-b399-40d6-b8a8-ea25ccbf522e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.234871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d329f5-da2f-4ee9-86b6-73f2c4676b9b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.238615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c4358-e192-4027-8bf8-bb653ac822b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.239351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4358-e192-4027-8bf8-bb653ac822b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.239634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4358-e192-4027-8bf8-bb653ac822b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.239909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4358-e192-4027-8bf8-bb653ac822b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.240691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c4358-e192-4027-8bf8-bb653ac822b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:18.240998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c4358-e192-4027-8bf8-bb653ac822b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.242866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c4358-e192-4027-8bf8-bb653ac822b6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.255511 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 791/1588] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:18.255511 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d329f5-da2f-4ee9-86b6-73f2c4676b9b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.271216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 798/1589] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:18.271216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c4358-e192-4027-8bf8-bb653ac822b6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.271474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d329f5-da2f-4ee9-86b6-73f2c4676b9b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.275255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b2e2f-59c7-42d0-abd6-611167437882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.276092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b2e2f-59c7-42d0-abd6-611167437882 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.276410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b2e2f-59c7-42d0-abd6-611167437882 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.276792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b2e2f-59c7-42d0-abd6-611167437882 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.277504 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b2e2f-59c7-42d0-abd6-611167437882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.279528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b2e2f-59c7-42d0-abd6-611167437882 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.282056 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c4358-e192-4027-8bf8-bb653ac822b6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.287053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a18fc-13db-4afb-b572-0894c2eea477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.287704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a18fc-13db-4afb-b572-0894c2eea477 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.287986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a18fc-13db-4afb-b572-0894c2eea477 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.288286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a18fc-13db-4afb-b572-0894c2eea477 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.288994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a18fc-13db-4afb-b572-0894c2eea477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.290904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a18fc-13db-4afb-b572-0894c2eea477 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.306398 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 792/1590] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/projects => generated 386 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:18.307298 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b2e2f-59c7-42d0-abd6-611167437882 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.322903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 799/1591] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/projects => generated 392 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:18.322903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a18fc-13db-4afb-b572-0894c2eea477 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.376527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b2e2f-59c7-42d0-abd6-611167437882 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.393172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a18fc-13db-4afb-b572-0894c2eea477 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.398618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f42da-eb89-4ca1-9f4a-b0fb091d6a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.399529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f42da-eb89-4ca1-9f4a-b0fb091d6a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.399815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f42da-eb89-4ca1-9f4a-b0fb091d6a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.400076 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f42da-eb89-4ca1-9f4a-b0fb091d6a7e admin admin] PATH_INFO: `/v3/projects/5a40b20d526747fdb4ac458d256575e3/users/388910b6889146fd9de804683f9162ae/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.420971 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f42da-eb89-4ca1-9f4a-b0fb091d6a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a40b20d526747fdb4ac458d256575e3, user_id=388910b6889146fd9de804683f9162ae, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.423683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f42da-eb89-4ca1-9f4a-b0fb091d6a7e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.438091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 800/1592] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:18 2022] PUT /identity/v3/projects/5a40b20d526747fdb4ac458d256575e3/users/388910b6889146fd9de804683f9162ae/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:18.438809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f42da-eb89-4ca1-9f4a-b0fb091d6a7e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.466501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ded3df-fe42-406e-9c9f-481c6f85e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.467617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ded3df-fe42-406e-9c9f-481c6f85e487 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.472580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ded3df-fe42-406e-9c9f-481c6f85e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.472941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ded3df-fe42-406e-9c9f-481c6f85e487 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.473734 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ded3df-fe42-406e-9c9f-481c6f85e487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.475784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ded3df-fe42-406e-9c9f-481c6f85e487 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.523437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 793/1593] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/projects => generated 376 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:18.524834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ded3df-fe42-406e-9c9f-481c6f85e487 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.545691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f42da-eb89-4ca1-9f4a-b0fb091d6a7e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.612813 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ded3df-fe42-406e-9c9f-481c6f85e487 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.617192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ed87e-da8b-4c89-a388-bad64bfd5afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.618094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ed87e-da8b-4c89-a388-bad64bfd5afe admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.618346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eb30f-b083-4c0e-a9bf-46cc83e376e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.618567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ed87e-da8b-4c89-a388-bad64bfd5afe admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.618969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ed87e-da8b-4c89-a388-bad64bfd5afe admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.619525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eb30f-b083-4c0e-a9bf-46cc83e376e3 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.619865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ed87e-da8b-4c89-a388-bad64bfd5afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.620242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eb30f-b083-4c0e-a9bf-46cc83e376e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.621718 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eb30f-b083-4c0e-a9bf-46cc83e376e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.622703 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ed87e-da8b-4c89-a388-bad64bfd5afe admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.623070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eb30f-b083-4c0e-a9bf-46cc83e376e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.625199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eb30f-b083-4c0e-a9bf-46cc83e376e3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.659031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 801/1594] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/projects => generated 386 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:18.662821 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 794/1595] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/projects => generated 380 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:18.664365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eb30f-b083-4c0e-a9bf-46cc83e376e3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.666484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ed87e-da8b-4c89-a388-bad64bfd5afe admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.744515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eb30f-b083-4c0e-a9bf-46cc83e376e3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.752973 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cdd95-9c6c-4d73-95ff-636ba7b7e0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.754016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cdd95-9c6c-4d73-95ff-636ba7b7e0ec admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.754456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cdd95-9c6c-4d73-95ff-636ba7b7e0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.754945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cdd95-9c6c-4d73-95ff-636ba7b7e0ec admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.756004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cdd95-9c6c-4d73-95ff-636ba7b7e0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.758148 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cdd95-9c6c-4d73-95ff-636ba7b7e0ec admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.765324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ed87e-da8b-4c89-a388-bad64bfd5afe admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.772410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3b79f-397f-4539-99a8-3f096898a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.773049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3b79f-397f-4539-99a8-3f096898a153 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.773340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3b79f-397f-4539-99a8-3f096898a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.773866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3b79f-397f-4539-99a8-3f096898a153 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.774687 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3b79f-397f-4539-99a8-3f096898a153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.778153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3b79f-397f-4539-99a8-3f096898a153 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.787180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 795/1596] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:18.788824 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cdd95-9c6c-4d73-95ff-636ba7b7e0ec admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.801329 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cdd95-9c6c-4d73-95ff-636ba7b7e0ec admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.806252 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4521-3af7-44d7-8ba4-0037783b42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.806954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4521-3af7-44d7-8ba4-0037783b42d7 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.807232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4521-3af7-44d7-8ba4-0037783b42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.807504 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4521-3af7-44d7-8ba4-0037783b42d7 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.808506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4521-3af7-44d7-8ba4-0037783b42d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.810535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4521-3af7-44d7-8ba4-0037783b42d7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.813315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 802/1597] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/projects => generated 386 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:18.815444 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65205bf-5acc-4686-8191-1c77d2edb9aa None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.815995 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65205bf-5acc-4686-8191-1c77d2edb9aa None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.816965 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65205bf-5acc-4686-8191-1c77d2edb9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.834036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 796/1598] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:18.835474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4521-3af7-44d7-8ba4-0037783b42d7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.850256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4521-3af7-44d7-8ba4-0037783b42d7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.861737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b65205bf-5acc-4686-8191-1c77d2edb9aa None None] MFA Rules not processed for user `388910b6889146fd9de804683f9162ae`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:18.862807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b65205bf-5acc-4686-8191-1c77d2edb9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:18.914325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dd9d5-8e57-4eae-bad3-5c036033b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.915724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dd9d5-8e57-4eae-bad3-5c036033b8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.916243 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dd9d5-8e57-4eae-bad3-5c036033b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.916532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dd9d5-8e57-4eae-bad3-5c036033b8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.917866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dd9d5-8e57-4eae-bad3-5c036033b8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.920360 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dd9d5-8e57-4eae-bad3-5c036033b8f4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.947489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 797/1599] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:18.948625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dd9d5-8e57-4eae-bad3-5c036033b8f4 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.966097 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 803/1600] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:18.966657 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dd9d5-8e57-4eae-bad3-5c036033b8f4 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:18.966782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65205bf-5acc-4686-8191-1c77d2edb9aa None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:18.967832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cc971-af79-456b-8566-1e3d4132278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:18.968510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cc971-af79-456b-8566-1e3d4132278a admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:18.968795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cc971-af79-456b-8566-1e3d4132278a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:18.969073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cc971-af79-456b-8566-1e3d4132278a admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:18.969830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cc971-af79-456b-8566-1e3d4132278a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:18.971869 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cc971-af79-456b-8566-1e3d4132278a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:18.988092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65205bf-5acc-4686-8191-1c77d2edb9aa None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.000636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 798/1601] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:19.000636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cc971-af79-456b-8566-1e3d4132278a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.001974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd76b6-b355-4d81-8581-33c2fcb0fe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.003443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd76b6-b355-4d81-8581-33c2fcb0fe1b admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.003962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd76b6-b355-4d81-8581-33c2fcb0fe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.004404 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd76b6-b355-4d81-8581-33c2fcb0fe1b admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.005329 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd76b6-b355-4d81-8581-33c2fcb0fe1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.008605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd76b6-b355-4d81-8581-33c2fcb0fe1b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.010703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cc971-af79-456b-8566-1e3d4132278a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.016585 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bb4bc-5bcb-4727-9012-ff1f711c8fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.017379 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb4bc-5bcb-4727-9012-ff1f711c8fbd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.017740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb4bc-5bcb-4727-9012-ff1f711c8fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.018107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb4bc-5bcb-4727-9012-ff1f711c8fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.018960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bb4bc-5bcb-4727-9012-ff1f711c8fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.020649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bb4bc-5bcb-4727-9012-ff1f711c8fbd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.033690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 799/1602] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:18 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.037016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bb4bc-5bcb-4727-9012-ff1f711c8fbd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.045492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 804/1603] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:18 2022] POST /identity/v3/users => generated 291 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:19.050778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bb4bc-5bcb-4727-9012-ff1f711c8fbd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.051697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd76b6-b355-4d81-8581-33c2fcb0fe1b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.056873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46764a6-8457-48ee-87c3-e50f60aff94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.060407 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46764a6-8457-48ee-87c3-e50f60aff94b admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.060845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46764a6-8457-48ee-87c3-e50f60aff94b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.061219 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46764a6-8457-48ee-87c3-e50f60aff94b admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.062041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46764a6-8457-48ee-87c3-e50f60aff94b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.064211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46764a6-8457-48ee-87c3-e50f60aff94b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.065540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd76b6-b355-4d81-8581-33c2fcb0fe1b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.070814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e6c18-0171-40e0-b226-204ef50b3c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.072202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6c18-0171-40e0-b226-204ef50b3c82 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.072661 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6c18-0171-40e0-b226-204ef50b3c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.072964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6c18-0171-40e0-b226-204ef50b3c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.075496 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e6c18-0171-40e0-b226-204ef50b3c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.078969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e6c18-0171-40e0-b226-204ef50b3c82 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.094834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 800/1604] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:19 2022] POST /identity/v3/users => generated 294 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:19.094834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46764a6-8457-48ee-87c3-e50f60aff94b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.096015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 805/1605] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.097398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9da1c-92ea-4c56-8947-c82f1c65aea1 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.097691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9da1c-92ea-4c56-8947-c82f1c65aea1 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.097969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9da1c-92ea-4c56-8947-c82f1c65aea1 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.101513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 806/1606] 10.222.0.117 () {54 vars in 966 bytes} [Mon Jan 24 16:50:19 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:50:19.103589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9da1c-92ea-4c56-8947-c82f1c65aea1 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.111398 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46764a6-8457-48ee-87c3-e50f60aff94b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.124194 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d1b1-93b7-4485-800e-d2cada61e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.124875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d1b1-93b7-4485-800e-d2cada61e808 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.125157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d1b1-93b7-4485-800e-d2cada61e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.125429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d1b1-93b7-4485-800e-d2cada61e808 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.126216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691d1b1-93b7-4485-800e-d2cada61e808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.127898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691d1b1-93b7-4485-800e-d2cada61e808 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.129171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9da1c-92ea-4c56-8947-c82f1c65aea1 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.134951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebc24e-c29c-4107-82ee-fb5a862089cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.136381 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebc24e-c29c-4107-82ee-fb5a862089cc admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.140509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebc24e-c29c-4107-82ee-fb5a862089cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.140819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebc24e-c29c-4107-82ee-fb5a862089cc admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.142422 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebc24e-c29c-4107-82ee-fb5a862089cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.144293 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebc24e-c29c-4107-82ee-fb5a862089cc admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.147830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 801/1607] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.147830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d1b1-93b7-4485-800e-d2cada61e808 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.157087 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d1b1-93b7-4485-800e-d2cada61e808 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.163440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ac122-be4c-4655-9460-1b6a9fb3d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.165092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ac122-be4c-4655-9460-1b6a9fb3d0ac admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.165544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ac122-be4c-4655-9460-1b6a9fb3d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.165966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ac122-be4c-4655-9460-1b6a9fb3d0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.167054 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ac122-be4c-4655-9460-1b6a9fb3d0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.167855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 807/1608] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.169471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ac122-be4c-4655-9460-1b6a9fb3d0ac admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.170480 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebc24e-c29c-4107-82ee-fb5a862089cc admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.181454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 802/1609] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.183134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ac122-be4c-4655-9460-1b6a9fb3d0ac admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.194528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebc24e-c29c-4107-82ee-fb5a862089cc admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.198887 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ac122-be4c-4655-9460-1b6a9fb3d0ac admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.202120 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac56f2-5e4f-43e8-8f73-1a45f763ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.203216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac56f2-5e4f-43e8-8f73-1a45f763ef53 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.204056 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac56f2-5e4f-43e8-8f73-1a45f763ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.204874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac56f2-5e4f-43e8-8f73-1a45f763ef53 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.206706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac56f2-5e4f-43e8-8f73-1a45f763ef53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.208834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac56f2-5e4f-43e8-8f73-1a45f763ef53 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.211999 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b363f23-0021-4ea8-8d64-a5dacb773d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.212673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b363f23-0021-4ea8-8d64-a5dacb773d79 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.212966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b363f23-0021-4ea8-8d64-a5dacb773d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.213247 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b363f23-0021-4ea8-8d64-a5dacb773d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.214063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b363f23-0021-4ea8-8d64-a5dacb773d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.216293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b363f23-0021-4ea8-8d64-a5dacb773d79 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.224208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 808/1610] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.226708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac56f2-5e4f-43e8-8f73-1a45f763ef53 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.232788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 803/1611] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.234426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eccf6a-ac4f-47b7-aac3-6c6d636f7c19 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.234925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eccf6a-ac4f-47b7-aac3-6c6d636f7c19 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.235371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eccf6a-ac4f-47b7-aac3-6c6d636f7c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.243379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac56f2-5e4f-43e8-8f73-1a45f763ef53 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.251865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928003-9ac9-49de-aa2b-ec5ca4160e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.252980 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928003-9ac9-49de-aa2b-ec5ca4160e57 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.253364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928003-9ac9-49de-aa2b-ec5ca4160e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.253740 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928003-9ac9-49de-aa2b-ec5ca4160e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.254671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87928003-9ac9-49de-aa2b-ec5ca4160e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.257305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87928003-9ac9-49de-aa2b-ec5ca4160e57 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.264871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e5eccf6a-ac4f-47b7-aac3-6c6d636f7c19 None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:19.266518 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e5eccf6a-ac4f-47b7-aac3-6c6d636f7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:19.273439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 809/1612] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.274474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928003-9ac9-49de-aa2b-ec5ca4160e57 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.284640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928003-9ac9-49de-aa2b-ec5ca4160e57 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.289630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c914d3-3ab9-40be-935d-e9ce2c47ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.290391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c914d3-3ab9-40be-935d-e9ce2c47ba3f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.290780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c914d3-3ab9-40be-935d-e9ce2c47ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.291175 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c914d3-3ab9-40be-935d-e9ce2c47ba3f admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.292529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c914d3-3ab9-40be-935d-e9ce2c47ba3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.294502 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c914d3-3ab9-40be-935d-e9ce2c47ba3f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.306083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 810/1613] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.307154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c914d3-3ab9-40be-935d-e9ce2c47ba3f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.319181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c914d3-3ab9-40be-935d-e9ce2c47ba3f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.324827 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48044ffa-362c-4c85-b148-d946cd062390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.325354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48044ffa-362c-4c85-b148-d946cd062390 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.325812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48044ffa-362c-4c85-b148-d946cd062390 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.326235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48044ffa-362c-4c85-b148-d946cd062390 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.327041 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48044ffa-362c-4c85-b148-d946cd062390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.328799 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48044ffa-362c-4c85-b148-d946cd062390 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.351049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 811/1614] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.351950 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48044ffa-362c-4c85-b148-d946cd062390 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.353112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 804/1615] 10.222.0.117 () {58 vars in 1063 bytes} [Mon Jan 24 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:19.353947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eccf6a-ac4f-47b7-aac3-6c6d636f7c19 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.366685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eccf6a-ac4f-47b7-aac3-6c6d636f7c19 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.371260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48044ffa-362c-4c85-b148-d946cd062390 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.372447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7414a25-12b2-4c9f-be16-6016de2b4412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.373200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414a25-12b2-4c9f-be16-6016de2b4412 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.373558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414a25-12b2-4c9f-be16-6016de2b4412 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.373961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414a25-12b2-4c9f-be16-6016de2b4412 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.374896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7414a25-12b2-4c9f-be16-6016de2b4412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.376719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7414a25-12b2-4c9f-be16-6016de2b4412 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.377648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0949fb-803d-4556-88ca-6c9d4c539964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.378699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0949fb-803d-4556-88ca-6c9d4c539964 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.379131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0949fb-803d-4556-88ca-6c9d4c539964 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.379538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0949fb-803d-4556-88ca-6c9d4c539964 admin admin] PATH_INFO: `/v3/projects/d37a3d8beec04ff28cd495e98dff4ab8/users/15edcc7ef2954bc18df15c42c914e682/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.389227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 805/1616] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.390075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7414a25-12b2-4c9f-be16-6016de2b4412 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.398376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0949fb-803d-4556-88ca-6c9d4c539964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37a3d8beec04ff28cd495e98dff4ab8, user_id=15edcc7ef2954bc18df15c42c914e682, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.401336 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7414a25-12b2-4c9f-be16-6016de2b4412 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.402038 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0949fb-803d-4556-88ca-6c9d4c539964 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.407026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d194-2f6b-4a73-85e8-c6046720b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.407776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d194-2f6b-4a73-85e8-c6046720b653 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.408122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d194-2f6b-4a73-85e8-c6046720b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.408345 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d194-2f6b-4a73-85e8-c6046720b653 admin admin] PATH_INFO: `/v3/projects/bed4ca830bf54f2493c46fb3cf3fbbc6/users/f86b459cc02f4f38a2ced5f25972535f/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.422301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 812/1617] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:19 2022] PUT /identity/v3/projects/d37a3d8beec04ff28cd495e98dff4ab8/users/15edcc7ef2954bc18df15c42c914e682/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:19.423590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0949fb-803d-4556-88ca-6c9d4c539964 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.453452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877d194-2f6b-4a73-85e8-c6046720b653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed4ca830bf54f2493c46fb3cf3fbbc6, user_id=f86b459cc02f4f38a2ced5f25972535f, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.457615 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877d194-2f6b-4a73-85e8-c6046720b653 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.484951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 806/1618] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:19 2022] PUT /identity/v3/projects/bed4ca830bf54f2493c46fb3cf3fbbc6/users/f86b459cc02f4f38a2ced5f25972535f/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:19.487644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d194-2f6b-4a73-85e8-c6046720b653 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.528615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0949fb-803d-4556-88ca-6c9d4c539964 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.638264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d194-2f6b-4a73-85e8-c6046720b653 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.638264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6eaef-7c8b-4214-8195-9f0488231d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.638264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6eaef-7c8b-4214-8195-9f0488231d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.638264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6eaef-7c8b-4214-8195-9f0488231d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.640162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6eaef-7c8b-4214-8195-9f0488231d0b admin admin] PATH_INFO: `/v3/projects/24a57596de944ff6b3c322128a836000/users/edb10d68444a4c6e947c1e356987736f/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.640162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6eaef-7c8b-4214-8195-9f0488231d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a57596de944ff6b3c322128a836000, user_id=edb10d68444a4c6e947c1e356987736f, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.644982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6eaef-7c8b-4214-8195-9f0488231d0b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.653584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228b579-966f-47bf-9cfa-30c0dd99795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.654504 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b579-966f-47bf-9cfa-30c0dd99795e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.654994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b579-966f-47bf-9cfa-30c0dd99795e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.655429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b579-966f-47bf-9cfa-30c0dd99795e admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.656276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228b579-966f-47bf-9cfa-30c0dd99795e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.657995 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228b579-966f-47bf-9cfa-30c0dd99795e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.668384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 807/1619] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:19 2022] PUT /identity/v3/projects/24a57596de944ff6b3c322128a836000/users/edb10d68444a4c6e947c1e356987736f/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:19.668384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6eaef-7c8b-4214-8195-9f0488231d0b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.669582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 813/1620] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:19.670573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228b579-966f-47bf-9cfa-30c0dd99795e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.763999 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6eaef-7c8b-4214-8195-9f0488231d0b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.770060 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc366d-dc1a-43c4-8a4e-dfddb082261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.771141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc366d-dc1a-43c4-8a4e-dfddb082261c admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.771420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc366d-dc1a-43c4-8a4e-dfddb082261c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.771690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc366d-dc1a-43c4-8a4e-dfddb082261c admin admin] PATH_INFO: `/v3/projects/23f1bf5dafe744d48d952fbe6209dd79/users/feb8ddf0abd84c1caed8501c57b56f20/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.771914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228b579-966f-47bf-9cfa-30c0dd99795e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.794661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc366d-dc1a-43c4-8a4e-dfddb082261c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f1bf5dafe744d48d952fbe6209dd79, user_id=feb8ddf0abd84c1caed8501c57b56f20, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.797316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc366d-dc1a-43c4-8a4e-dfddb082261c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.821256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 808/1621] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:19 2022] PUT /identity/v3/projects/23f1bf5dafe744d48d952fbe6209dd79/users/feb8ddf0abd84c1caed8501c57b56f20/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:19.822155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc366d-dc1a-43c4-8a4e-dfddb082261c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:19.851137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46033e1-591d-4c4f-bf73-a939c151d89e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.851137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46033e1-591d-4c4f-bf73-a939c151d89e service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.851442 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46033e1-591d-4c4f-bf73-a939c151d89e service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.851442 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46033e1-591d-4c4f-bf73-a939c151d89e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.888756 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc366d-dc1a-43c4-8a4e-dfddb082261c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:19.894244 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96934f5-38a2-4ffe-b86f-d6ff2aed8a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:19.895167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96934f5-38a2-4ffe-b86f-d6ff2aed8a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.895447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96934f5-38a2-4ffe-b86f-d6ff2aed8a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.895717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96934f5-38a2-4ffe-b86f-d6ff2aed8a01 admin admin] PATH_INFO: `/v3/projects/8d59c94478d24e3f917829b148941337/users/3b9a988ccba046e399cb0f755b9a03e1/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.911668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46033e1-591d-4c4f-bf73-a939c151d89e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.913363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46033e1-591d-4c4f-bf73-a939c151d89e service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.913505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96934f5-38a2-4ffe-b86f-d6ff2aed8a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d59c94478d24e3f917829b148941337, user_id=3b9a988ccba046e399cb0f755b9a03e1, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:19.916344 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96934f5-38a2-4ffe-b86f-d6ff2aed8a01 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:19.923725 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 814/1622] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:19.925093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6fae1-6064-42ae-a5e8-c86f027056a6 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.925516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6fae1-6064-42ae-a5e8-c86f027056a6 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.925804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6fae1-6064-42ae-a5e8-c86f027056a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.945027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 809/1623] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:19 2022] PUT /identity/v3/projects/8d59c94478d24e3f917829b148941337/users/3b9a988ccba046e399cb0f755b9a03e1/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:19.947206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9b295-48b9-4725-a74b-73eee4d029ec None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:19.947715 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9b295-48b9-4725-a74b-73eee4d029ec None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:19.948276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9b295-48b9-4725-a74b-73eee4d029ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:19.955631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-6db6fae1-6064-42ae-a5e8-c86f027056a6 None None] MFA Rules not processed for user `15edcc7ef2954bc18df15c42c914e682`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:19.957325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6db6fae1-6064-42ae-a5e8-c86f027056a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:19.971016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a0b9b295-48b9-4725-a74b-73eee4d029ec None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:19.972527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a0b9b295-48b9-4725-a74b-73eee4d029ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:20.035371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 815/1624] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:20.036735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff904c-0145-48ae-98b6-55348a2532df None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.037078 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff904c-0145-48ae-98b6-55348a2532df None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.037360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff904c-0145-48ae-98b6-55348a2532df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.055899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-37ff904c-0145-48ae-98b6-55348a2532df None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:20.056225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 810/1625] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:20.057083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-37ff904c-0145-48ae-98b6-55348a2532df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:20.057354 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9b295-48b9-4725-a74b-73eee4d029ec None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:20.069175 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9b295-48b9-4725-a74b-73eee4d029ec None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:20.076479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 816/1626] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:20.076479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820f40-68ed-442c-8427-e87db7749cfa None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.076479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820f40-68ed-442c-8427-e87db7749cfa None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.076479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820f40-68ed-442c-8427-e87db7749cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.083015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e0ea9-f115-41d9-9e4d-260598160959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:20.084842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e0ea9-f115-41d9-9e4d-260598160959 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.085502 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e0ea9-f115-41d9-9e4d-260598160959 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.086099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e0ea9-f115-41d9-9e4d-260598160959 admin admin] PATH_INFO: `/v3/projects/b66cbb5472e744d084d67cd91d835d10/users/003057b689524c49b7ef8ea20f3bee63/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.099221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-58820f40-68ed-442c-8427-e87db7749cfa None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:20.100442 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-58820f40-68ed-442c-8427-e87db7749cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:20.108831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e0ea9-f115-41d9-9e4d-260598160959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66cbb5472e744d084d67cd91d835d10, user_id=003057b689524c49b7ef8ea20f3bee63, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:20.109028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 817/1627] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:20.111317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7872780-c0be-41ec-ae40-98ec8e3229ad None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.111831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7872780-c0be-41ec-ae40-98ec8e3229ad None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.112427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e0ea9-f115-41d9-9e4d-260598160959 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:20.119448 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7872780-c0be-41ec-ae40-98ec8e3229ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.130076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 811/1628] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:20 2022] PUT /identity/v3/projects/b66cbb5472e744d084d67cd91d835d10/users/003057b689524c49b7ef8ea20f3bee63/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:20.131551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e0ea9-f115-41d9-9e4d-260598160959 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:20.141195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-e7872780-c0be-41ec-ae40-98ec8e3229ad None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:20.142425 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e7872780-c0be-41ec-ae40-98ec8e3229ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:20.217681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 818/1629] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:20.218845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7872780-c0be-41ec-ae40-98ec8e3229ad None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:20.220070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e7872780-c0be-41ec-ae40-98ec8e3229ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:20.255840 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e0ea9-f115-41d9-9e4d-260598160959 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:20.262886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5894c23-8295-45a5-85b3-9e87ffabe06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:20.263562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5894c23-8295-45a5-85b3-9e87ffabe06f admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.263845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5894c23-8295-45a5-85b3-9e87ffabe06f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.264122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5894c23-8295-45a5-85b3-9e87ffabe06f admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.264840 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5894c23-8295-45a5-85b3-9e87ffabe06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:20.266784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5894c23-8295-45a5-85b3-9e87ffabe06f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:20.289309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7872780-c0be-41ec-ae40-98ec8e3229ad None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:20.296082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f31924-42c9-4cf7-ae7d-fa321a791b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:20.296850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31924-42c9-4cf7-ae7d-fa321a791b3c service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.297198 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31924-42c9-4cf7-ae7d-fa321a791b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.297539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31924-42c9-4cf7-ae7d-fa321a791b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.302306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 812/1630] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:20 2022] POST /identity/v3/projects => generated 386 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:20.306206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5894c23-8295-45a5-85b3-9e87ffabe06f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:20.308832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f31924-42c9-4cf7-ae7d-fa321a791b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:20.310435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f31924-42c9-4cf7-ae7d-fa321a791b3c service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:20.322145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 819/1631] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:20.323724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f31924-42c9-4cf7-ae7d-fa321a791b3c service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:20.335652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f31924-42c9-4cf7-ae7d-fa321a791b3c service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:20.400862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5894c23-8295-45a5-85b3-9e87ffabe06f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:20.405823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60036e-b01d-4d31-9c6d-c8a7fbb9ef04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:20.406542 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60036e-b01d-4d31-9c6d-c8a7fbb9ef04 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.406917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60036e-b01d-4d31-9c6d-c8a7fbb9ef04 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.408405 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60036e-b01d-4d31-9c6d-c8a7fbb9ef04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.412875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fc328-5e23-4ce8-8a80-c7f4cbd35382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:20.413542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fc328-5e23-4ce8-8a80-c7f4cbd35382 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.413877 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fc328-5e23-4ce8-8a80-c7f4cbd35382 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.414166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fc328-5e23-4ce8-8a80-c7f4cbd35382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.511436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fc328-5e23-4ce8-8a80-c7f4cbd35382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:20.513666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fc328-5e23-4ce8-8a80-c7f4cbd35382 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:20.521433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60036e-b01d-4d31-9c6d-c8a7fbb9ef04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:20.522963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60036e-b01d-4d31-9c6d-c8a7fbb9ef04 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:20.538407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 820/1632] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:20.548270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f52d72-a817-48f8-ac20-05d4c934c16f None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.548541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 813/1633] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:20.548666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f52d72-a817-48f8-ac20-05d4c934c16f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.549004 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f52d72-a817-48f8-ac20-05d4c934c16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.549390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60036e-b01d-4d31-9c6d-c8a7fbb9ef04 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:20.567180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60036e-b01d-4d31-9c6d-c8a7fbb9ef04 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:20.577866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0b2d3-2ae1-4a3c-8bdb-9edd6d288c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:20.578611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0b2d3-2ae1-4a3c-8bdb-9edd6d288c4b service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.578998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0b2d3-2ae1-4a3c-8bdb-9edd6d288c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.579349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0b2d3-2ae1-4a3c-8bdb-9edd6d288c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.598709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0b2d3-2ae1-4a3c-8bdb-9edd6d288c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:20.603852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0b2d3-2ae1-4a3c-8bdb-9edd6d288c4b service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:20.614117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-c3f52d72-a817-48f8-ac20-05d4c934c16f None None] MFA Rules not processed for user `003057b689524c49b7ef8ea20f3bee63`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:20.615537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c3f52d72-a817-48f8-ac20-05d4c934c16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:20.625565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 814/1634] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:20.629652 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8295-a911-4286-a559-530ae82ab793 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.630187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8295-a911-4286-a559-530ae82ab793 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.632699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8295-a911-4286-a559-530ae82ab793 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.637588 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 815/1635] 10.222.0.117 () {54 vars in 917 bytes} [Mon Jan 24 16:50:20 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:50:20.640187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c8295-a911-4286-a559-530ae82ab793 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:20.674625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c8295-a911-4286-a559-530ae82ab793 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:20.690433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6429da-b62d-4ad8-b243-bd8d74c2a1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:20.691291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6429da-b62d-4ad8-b243-bd8d74c2a1fe admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.691574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6429da-b62d-4ad8-b243-bd8d74c2a1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.691846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6429da-b62d-4ad8-b243-bd8d74c2a1fe admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.692560 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6429da-b62d-4ad8-b243-bd8d74c2a1fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:20.699070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6429da-b62d-4ad8-b243-bd8d74c2a1fe admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:20.749839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 816/1636] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:20 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:20.752778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56666324-0850-4fea-ac9f-714998ff9019 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.753210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56666324-0850-4fea-ac9f-714998ff9019 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.757748 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56666324-0850-4fea-ac9f-714998ff9019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.796082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 821/1637] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:20.797298 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f52d72-a817-48f8-ac20-05d4c934c16f None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:20.807646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-56666324-0850-4fea-ac9f-714998ff9019 None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:20.816068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-56666324-0850-4fea-ac9f-714998ff9019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:20.831338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f52d72-a817-48f8-ac20-05d4c934c16f None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:20.845506 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f029d13-fee7-409c-82b0-ab6355891c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:20.846488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f029d13-fee7-409c-82b0-ab6355891c96 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.846953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f029d13-fee7-409c-82b0-ab6355891c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.847410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f029d13-fee7-409c-82b0-ab6355891c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.848355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f029d13-fee7-409c-82b0-ab6355891c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:20.856381 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f029d13-fee7-409c-82b0-ab6355891c96 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:20.941579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 817/1638] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:20.943271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9889d72-1243-4c8a-a506-15ae834ec3e8 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.943563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9889d72-1243-4c8a-a506-15ae834ec3e8 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.943828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9889d72-1243-4c8a-a506-15ae834ec3e8 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.953216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 822/1639] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:20 2022] GET /identity/v3/roles => generated 1427 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:20.954714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb42f2f-2704-49a7-b48a-8be5033c1836 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:20.955058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb42f2f-2704-49a7-b48a-8be5033c1836 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:20.955314 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb42f2f-2704-49a7-b48a-8be5033c1836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:20.956345 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 818/1640] 10.222.0.117 () {54 vars in 966 bytes} [Mon Jan 24 16:50:20 2022] GET /identity => generated 271 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:50:20.957695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9889d72-1243-4c8a-a506-15ae834ec3e8 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:20.991706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-8fb42f2f-2704-49a7-b48a-8be5033c1836 None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:20.993916 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8fb42f2f-2704-49a7-b48a-8be5033c1836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:21.022065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9889d72-1243-4c8a-a506-15ae834ec3e8 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:21.024459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 823/1641] 10.222.0.117 () {58 vars in 1063 bytes} [Mon Jan 24 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:21.025345 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb42f2f-2704-49a7-b48a-8be5033c1836 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:21.035954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60f4bd-dbe2-46f2-8674-9cdd099ff8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:21.036711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60f4bd-dbe2-46f2-8674-9cdd099ff8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:21.036994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60f4bd-dbe2-46f2-8674-9cdd099ff8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:21.037317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60f4bd-dbe2-46f2-8674-9cdd099ff8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:21.049339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60f4bd-dbe2-46f2-8674-9cdd099ff8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:21.050939 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60f4bd-dbe2-46f2-8674-9cdd099ff8f3 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:21.051151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb42f2f-2704-49a7-b48a-8be5033c1836 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:21.074622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 819/1642] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:21.077828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60f4bd-dbe2-46f2-8674-9cdd099ff8f3 service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:21.087799 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240b9d2-b037-4706-ae10-bc2e1540a58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:21.089459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240b9d2-b037-4706-ae10-bc2e1540a58a admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:21.089604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240b9d2-b037-4706-ae10-bc2e1540a58a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:21.102548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60f4bd-dbe2-46f2-8674-9cdd099ff8f3 service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:21.103590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240b9d2-b037-4706-ae10-bc2e1540a58a admin admin] PATH_INFO: `/v3/projects/9cde6305f2314096a95ffce5562f3845/users/83af91fb3aef44c79ed382024ffdb833/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:21.116268 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7429fe9-fe05-43ee-bacf-033840ade5a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:21.118165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7429fe9-fe05-43ee-bacf-033840ade5a5 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:21.121081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7429fe9-fe05-43ee-bacf-033840ade5a5 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:21.121594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7429fe9-fe05-43ee-bacf-033840ade5a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:21.145260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7429fe9-fe05-43ee-bacf-033840ade5a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:21.149684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7429fe9-fe05-43ee-bacf-033840ade5a5 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:21.167897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 820/1643] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:21.183395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240b9d2-b037-4706-ae10-bc2e1540a58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cde6305f2314096a95ffce5562f3845, user_id=83af91fb3aef44c79ed382024ffdb833, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:21.186217 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240b9d2-b037-4706-ae10-bc2e1540a58a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:21.236176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 824/1644] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:21 2022] PUT /identity/v3/projects/9cde6305f2314096a95ffce5562f3845/users/83af91fb3aef44c79ed382024ffdb833/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:21.240089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7429fe9-fe05-43ee-bacf-033840ade5a5 service nova] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:21.258375 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7429fe9-fe05-43ee-bacf-033840ade5a5 service nova] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:21.410323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739d5ac-05ef-4938-aecc-ce55c480b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:21.411701 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739d5ac-05ef-4938-aecc-ce55c480b319 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:21.413542 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739d5ac-05ef-4938-aecc-ce55c480b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:21.413824 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739d5ac-05ef-4938-aecc-ce55c480b319 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:21.414588 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739d5ac-05ef-4938-aecc-ce55c480b319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:21.418810 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739d5ac-05ef-4938-aecc-ce55c480b319 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:21.446780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 821/1645] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:21 2022] GET /identity/v3/roles => generated 1427 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:21.447540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240b9d2-b037-4706-ae10-bc2e1540a58a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:21.463822 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240b9d2-b037-4706-ae10-bc2e1540a58a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:21.479067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169eba5-bd60-4600-a320-22a70c7fbf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:21.483553 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169eba5-bd60-4600-a320-22a70c7fbf24 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:21.485155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169eba5-bd60-4600-a320-22a70c7fbf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:21.485289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169eba5-bd60-4600-a320-22a70c7fbf24 admin admin] PATH_INFO: `/v3/projects/9cde6305f2314096a95ffce5562f3845/users/83af91fb3aef44c79ed382024ffdb833/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:21.495811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169eba5-bd60-4600-a320-22a70c7fbf24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cde6305f2314096a95ffce5562f3845, user_id=83af91fb3aef44c79ed382024ffdb833, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:21.508085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169eba5-bd60-4600-a320-22a70c7fbf24 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:21.560783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 825/1646] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:21 2022] PUT /identity/v3/projects/9cde6305f2314096a95ffce5562f3845/users/83af91fb3aef44c79ed382024ffdb833/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:50:21.571019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977c14c-f75c-4242-8765-e2d8860ee89d None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:21.571293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977c14c-f75c-4242-8765-e2d8860ee89d None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:21.571572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977c14c-f75c-4242-8765-e2d8860ee89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:21.640957 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-f977c14c-f75c-4242-8765-e2d8860ee89d None None] MFA Rules not processed for user `83af91fb3aef44c79ed382024ffdb833`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:21.646121 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f977c14c-f75c-4242-8765-e2d8860ee89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:21.853878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed41644-c855-4b4c-89f8-59ee8ef15811 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:21.854674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed41644-c855-4b4c-89f8-59ee8ef15811 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:21.855036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed41644-c855-4b4c-89f8-59ee8ef15811 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:21.857556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 826/1647] 10.222.0.117 () {54 vars in 917 bytes} [Mon Jan 24 16:50:21 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:50:21.864456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ead6b-b55a-47ff-986f-c8c8be86fc07 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:21.864748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ead6b-b55a-47ff-986f-c8c8be86fc07 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:21.865032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ead6b-b55a-47ff-986f-c8c8be86fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:21.883118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 822/1648] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:21.890404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977c14c-f75c-4242-8765-e2d8860ee89d None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:21.909006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-6c5ead6b-b55a-47ff-986f-c8c8be86fc07 None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:21.910927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6c5ead6b-b55a-47ff-986f-c8c8be86fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:22.004055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977c14c-f75c-4242-8765-e2d8860ee89d None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:22.008320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440898d7-eef3-4f38-8e0c-08876595e8c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:22.009755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440898d7-eef3-4f38-8e0c-08876595e8c9 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:22.009755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440898d7-eef3-4f38-8e0c-08876595e8c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:22.010025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440898d7-eef3-4f38-8e0c-08876595e8c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:22.024047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440898d7-eef3-4f38-8e0c-08876595e8c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:22.025894 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440898d7-eef3-4f38-8e0c-08876595e8c9 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:22.061603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 827/1649] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:50:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:22.067044 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 823/1650] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:50:22.130701 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ead6b-b55a-47ff-986f-c8c8be86fc07 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:22.146042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ead6b-b55a-47ff-986f-c8c8be86fc07 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:22.158340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73b0ca-7606-474d-81f9-9ea01d876351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:22.159042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b0ca-7606-474d-81f9-9ea01d876351 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:22.159330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b0ca-7606-474d-81f9-9ea01d876351 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:22.159609 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b0ca-7606-474d-81f9-9ea01d876351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:22.185648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73b0ca-7606-474d-81f9-9ea01d876351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:22.188115 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73b0ca-7606-474d-81f9-9ea01d876351 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:22.207962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 828/1651] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:22.695299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440898d7-eef3-4f38-8e0c-08876595e8c9 service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:22.886864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440898d7-eef3-4f38-8e0c-08876595e8c9 service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:22.917502 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:22.920581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:22.921654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:22.923516 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] PATH_INFO: `/v3/users/15edcc7ef2954bc18df15c42c914e682` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:22.926288 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15edcc7ef2954bc18df15c42c914e682)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:22.927460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: WARNING py.warnings [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:50:22.927460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: warnings.warn(msg) Jan 24 16:50:22.927460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: Jan 24 16:50:22.934945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:23.072977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15edcc7ef2954bc18df15c42c914e682'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:23.103244 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15edcc7ef2954bc18df15c42c914e682'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:23.136675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15edcc7ef2954bc18df15c42c914e682'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:23.211794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15edcc7ef2954bc18df15c42c914e682'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:23.213667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15edcc7ef2954bc18df15c42c914e682'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:23.233396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 824/1652] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:22 2022] DELETE /identity/v3/users/15edcc7ef2954bc18df15c42c914e682 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:23.239195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa51962-283d-4527-a828-eb337a8b1600 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:23.240520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa51962-283d-4527-a828-eb337a8b1600 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:23.241730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa51962-283d-4527-a828-eb337a8b1600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:23.281882 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ffa51962-283d-4527-a828-eb337a8b1600 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:23.286204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ffa51962-283d-4527-a828-eb337a8b1600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:23.480787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 829/1653] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:23.598525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:23.600031 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:23.682014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799e8ae-1730-47ef-83cc-ae9bcfbdd556 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:23.682953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799e8ae-1730-47ef-83cc-ae9bcfbdd556 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:23.683227 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799e8ae-1730-47ef-83cc-ae9bcfbdd556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:23.735154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4799e8ae-1730-47ef-83cc-ae9bcfbdd556 None None] MFA Rules not processed for user `feb8ddf0abd84c1caed8501c57b56f20`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:23.736383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4799e8ae-1730-47ef-83cc-ae9bcfbdd556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:23.794279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019843b0-1af6-4bd9-999e-ce0bbf21f7d9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:23.799295 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35efce-02d1-4819-b9cc-fc177c18c202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:23.799856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35efce-02d1-4819-b9cc-fc177c18c202 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:23.800143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35efce-02d1-4819-b9cc-fc177c18c202 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:23.800426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35efce-02d1-4819-b9cc-fc177c18c202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:23.822809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35efce-02d1-4819-b9cc-fc177c18c202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:23.829388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35efce-02d1-4819-b9cc-fc177c18c202 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:23.849808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 825/1654] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:23.935598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 830/1655] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:23.947168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ee90d-1c51-4a49-a3fd-2b739e671b26 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:23.947490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ee90d-1c51-4a49-a3fd-2b739e671b26 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:23.947819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ee90d-1c51-4a49-a3fd-2b739e671b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:23.988547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b56ee90d-1c51-4a49-a3fd-2b739e671b26 None None] MFA Rules not processed for user `feb8ddf0abd84c1caed8501c57b56f20`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:23.990493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b56ee90d-1c51-4a49-a3fd-2b739e671b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:24.050529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 826/1656] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:24.139836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799e8ae-1730-47ef-83cc-ae9bcfbdd556 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:24.147914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4799e8ae-1730-47ef-83cc-ae9bcfbdd556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:24.338866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799e8ae-1730-47ef-83cc-ae9bcfbdd556 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:24.353780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963b3a6-2e25-4789-8de9-55eb525e153f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:24.355027 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b3a6-2e25-4789-8de9-55eb525e153f service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:24.355540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b3a6-2e25-4789-8de9-55eb525e153f service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:24.356029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b3a6-2e25-4789-8de9-55eb525e153f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:24.375479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963b3a6-2e25-4789-8de9-55eb525e153f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:24.377411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963b3a6-2e25-4789-8de9-55eb525e153f service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:24.415171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 831/1657] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:24.818284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ee90d-1c51-4a49-a3fd-2b739e671b26 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:24.820172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b56ee90d-1c51-4a49-a3fd-2b739e671b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:24.853896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ee90d-1c51-4a49-a3fd-2b739e671b26 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:24.867413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58346ff9-e080-4a92-981a-c63f2317ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:24.868700 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58346ff9-e080-4a92-981a-c63f2317ee8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:24.870062 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58346ff9-e080-4a92-981a-c63f2317ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:24.870062 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58346ff9-e080-4a92-981a-c63f2317ee8c admin admin] PATH_INFO: `/v3/users/388910b6889146fd9de804683f9162ae` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:24.872756 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58346ff9-e080-4a92-981a-c63f2317ee8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=388910b6889146fd9de804683f9162ae)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:24.877857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58346ff9-e080-4a92-981a-c63f2317ee8c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:24.983321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-58346ff9-e080-4a92-981a-c63f2317ee8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388910b6889146fd9de804683f9162ae'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:25.029750 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-58346ff9-e080-4a92-981a-c63f2317ee8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388910b6889146fd9de804683f9162ae'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:25.041638 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a638a1-ebb6-43a8-be88-ec8725ae90b1 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:25.044189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a638a1-ebb6-43a8-be88-ec8725ae90b1 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:25.045787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a638a1-ebb6-43a8-be88-ec8725ae90b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:25.054148 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-58346ff9-e080-4a92-981a-c63f2317ee8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388910b6889146fd9de804683f9162ae'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:25.100798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-58346ff9-e080-4a92-981a-c63f2317ee8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388910b6889146fd9de804683f9162ae'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:25.103116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-58346ff9-e080-4a92-981a-c63f2317ee8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388910b6889146fd9de804683f9162ae'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:25.114682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 827/1658] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:24 2022] DELETE /identity/v3/users/388910b6889146fd9de804683f9162ae => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:25.117974 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b143a18-24bb-42f2-939d-abd97097d330 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:25.118557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b143a18-24bb-42f2-939d-abd97097d330 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:25.119162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b143a18-24bb-42f2-939d-abd97097d330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:25.120491 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-09a638a1-ebb6-43a8-be88-ec8725ae90b1 None None] MFA Rules not processed for user `50e012c5fcde4462984a57878629fd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:25.122009 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-09a638a1-ebb6-43a8-be88-ec8725ae90b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:25.199158 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-8b143a18-24bb-42f2-939d-abd97097d330 None None] MFA Rules not processed for user `3b9a988ccba046e399cb0f755b9a03e1`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:25.202832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8b143a18-24bb-42f2-939d-abd97097d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:25.264116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 832/1659] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:25.265581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c92e1-b214-4166-bad0-f7ae4158bdff None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:25.265919 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c92e1-b214-4166-bad0-f7ae4158bdff None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:25.266200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c92e1-b214-4166-bad0-f7ae4158bdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:25.286501 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a76c92e1-b214-4166-bad0-f7ae4158bdff None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:25.287954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a76c92e1-b214-4166-bad0-f7ae4158bdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:25.302739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 828/1660] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:25.304060 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b143a18-24bb-42f2-939d-abd97097d330 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:25.306474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8b143a18-24bb-42f2-939d-abd97097d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:25.384195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b143a18-24bb-42f2-939d-abd97097d330 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:25.389756 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:25.390808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:25.391233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:25.391595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] PATH_INFO: `/v3/projects/d37a3d8beec04ff28cd495e98dff4ab8` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:25.393005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37a3d8beec04ff28cd495e98dff4ab8)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:25.395127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:25.395383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 833/1661] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:25.396986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c92e1-b214-4166-bad0-f7ae4158bdff None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:25.398489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a76c92e1-b214-4166-bad0-f7ae4158bdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:25.477008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37a3d8beec04ff28cd495e98dff4ab8', 'request_id': 'req-e490f953-bc23-445d-9cc9-dadd719b4776'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:25.498065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37a3d8beec04ff28cd495e98dff4ab8', 'request_id': 'req-e490f953-bc23-445d-9cc9-dadd719b4776'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:25.507962 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37a3d8beec04ff28cd495e98dff4ab8', 'request_id': 'req-e490f953-bc23-445d-9cc9-dadd719b4776'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:25.529565 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c92e1-b214-4166-bad0-f7ae4158bdff None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:25.533792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] The token cache is being invalidate because project d37a3d8beec04ff28cd495e98dff4ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:25.534081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:25.534838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e490f953-bc23-445d-9cc9-dadd719b4776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:25.536717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 829/1662] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:25 2022] DELETE /identity/v3/projects/d37a3d8beec04ff28cd495e98dff4ab8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:25.538512 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade6854-7989-4a0d-8d3d-ef3838fcc6aa None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:25.538825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade6854-7989-4a0d-8d3d-ef3838fcc6aa None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:25.539104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade6854-7989-4a0d-8d3d-ef3838fcc6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:25.598040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-2ade6854-7989-4a0d-8d3d-ef3838fcc6aa None None] MFA Rules not processed for user `3b9a988ccba046e399cb0f755b9a03e1`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:25.599645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-2ade6854-7989-4a0d-8d3d-ef3838fcc6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:25.667965 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e58093-6e83-431f-8438-682f4abc86b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:25.668634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e58093-6e83-431f-8438-682f4abc86b5 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:25.668999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e58093-6e83-431f-8438-682f4abc86b5 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:25.669182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e58093-6e83-431f-8438-682f4abc86b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:25.674870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b3e58093-6e83-431f-8438-682f4abc86b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:25.716846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 830/1663] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:25.726788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed783d1a-d048-4627-9cf3-d6d27911b769 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:25.727400 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed783d1a-d048-4627-9cf3-d6d27911b769 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:25.727625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed783d1a-d048-4627-9cf3-d6d27911b769 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:25.738072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 831/1664] 10.222.0.117 () {54 vars in 917 bytes} [Mon Jan 24 16:50:25 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:50:25.739554 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed783d1a-d048-4627-9cf3-d6d27911b769 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:25.746721 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ed783d1a-d048-4627-9cf3-d6d27911b769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:25.843773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e58093-6e83-431f-8438-682f4abc86b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:25.845771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e58093-6e83-431f-8438-682f4abc86b5 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:25.875880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 834/1665] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:25.877067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e58093-6e83-431f-8438-682f4abc86b5 service nova] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:25.879905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b3e58093-6e83-431f-8438-682f4abc86b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:25.956325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed783d1a-d048-4627-9cf3-d6d27911b769 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:25.974264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4ed9c-1399-4d4d-abb6-dceaa2e17671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:25.974992 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ed9c-1399-4d4d-abb6-dceaa2e17671 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:25.976643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ed9c-1399-4d4d-abb6-dceaa2e17671 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:25.977080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ed9c-1399-4d4d-abb6-dceaa2e17671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:25.986002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f9d4ed9c-1399-4d4d-abb6-dceaa2e17671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:26.037158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e58093-6e83-431f-8438-682f4abc86b5 service nova] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:26.044790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:26.045816 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:26.046099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:26.046370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] PATH_INFO: `/v3/users/83af91fb3aef44c79ed382024ffdb833` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:26.047938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83af91fb3aef44c79ed382024ffdb833)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:26.050898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:26.148758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4ed9c-1399-4d4d-abb6-dceaa2e17671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:26.150674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4ed9c-1399-4d4d-abb6-dceaa2e17671 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:26.164513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83af91fb3aef44c79ed382024ffdb833'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:26.180061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 832/1666] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:26.181032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83af91fb3aef44c79ed382024ffdb833'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:26.182208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83af91fb3aef44c79ed382024ffdb833'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:26.183021 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83af91fb3aef44c79ed382024ffdb833'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:26.184196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2a583-1422-4e2a-a0c6-a8c3fcf5e60b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:26.184683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2a583-1422-4e2a-a0c6-a8c3fcf5e60b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:26.185735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2a583-1422-4e2a-a0c6-a8c3fcf5e60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:26.216097 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83af91fb3aef44c79ed382024ffdb833'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:26.251145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 835/1667] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:25 2022] DELETE /identity/v3/users/83af91fb3aef44c79ed382024ffdb833 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:26.280875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-9aa2a583-1422-4e2a-a0c6-a8c3fcf5e60b None None] MFA Rules not processed for user `aa9834b75e2b4ac787f3917564090d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:26.283038 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9aa2a583-1422-4e2a-a0c6-a8c3fcf5e60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:26.285282 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:26.288279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:26.403619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbf523-4d47-4c99-8788-3b230dd748d5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:26.412258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3f2ef-126f-4101-b5ef-76df2b91712c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:26.413299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3f2ef-126f-4101-b5ef-76df2b91712c service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:26.413825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3f2ef-126f-4101-b5ef-76df2b91712c service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:26.414327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3f2ef-126f-4101-b5ef-76df2b91712c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:26.418737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-80e3f2ef-126f-4101-b5ef-76df2b91712c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:26.428348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 833/1668] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:50:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:26.450022 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2a583-1422-4e2a-a0c6-a8c3fcf5e60b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:26.453050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9aa2a583-1422-4e2a-a0c6-a8c3fcf5e60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:26.473079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2a583-1422-4e2a-a0c6-a8c3fcf5e60b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:26.483880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f055ef-584a-4a07-9c10-b6b753a061b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:26.484459 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f055ef-584a-4a07-9c10-b6b753a061b1 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:26.484740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f055ef-584a-4a07-9c10-b6b753a061b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:26.485021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f055ef-584a-4a07-9c10-b6b753a061b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:26.503156 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f055ef-584a-4a07-9c10-b6b753a061b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:26.504781 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f055ef-584a-4a07-9c10-b6b753a061b1 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:26.517364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3f2ef-126f-4101-b5ef-76df2b91712c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:26.519935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3f2ef-126f-4101-b5ef-76df2b91712c service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:26.521503 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 834/1669] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:50:26.534152 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 836/1670] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:50:27.469949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f055ef-584a-4a07-9c10-b6b753a061b1 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:27.471417 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-60f055ef-584a-4a07-9c10-b6b753a061b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:27.587935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f055ef-584a-4a07-9c10-b6b753a061b1 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:27.596221 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806409c-c50f-463b-894f-6677d62856e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15975bd016ed48f9bf5c88845180ebf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:27.597955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806409c-c50f-463b-894f-6677d62856e0 service placement] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:27.598483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806409c-c50f-463b-894f-6677d62856e0 service placement] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:27.599129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806409c-c50f-463b-894f-6677d62856e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:27.602076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5806409c-c50f-463b-894f-6677d62856e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:27.618702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806409c-c50f-463b-894f-6677d62856e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:27.620864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806409c-c50f-463b-894f-6677d62856e0 service placement] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:27.647957 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 835/1671] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:27.759174 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b37e9-c110-476d-8aca-b2421a6d8a35 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:27.759711 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b37e9-c110-476d-8aca-b2421a6d8a35 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:27.760790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b37e9-c110-476d-8aca-b2421a6d8a35 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:27.764553 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 837/1672] 10.222.0.117 () {54 vars in 917 bytes} [Mon Jan 24 16:50:27 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:50:27.771041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab9443-04c7-4214-a480-7b22bd33ffb0 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:27.771408 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab9443-04c7-4214-a480-7b22bd33ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:27.771651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab9443-04c7-4214-a480-7b22bd33ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:27.814401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b2ab9443-04c7-4214-a480-7b22bd33ffb0 None None] MFA Rules not processed for user `aa9834b75e2b4ac787f3917564090d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:27.817066 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b2ab9443-04c7-4214-a480-7b22bd33ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:27.856353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 836/1673] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:50:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:27.876039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b37e9-c110-476d-8aca-b2421a6d8a35 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:27.878537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-db5b37e9-c110-476d-8aca-b2421a6d8a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:27.933830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b37e9-c110-476d-8aca-b2421a6d8a35 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:27.951713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf2adc-8d45-419a-858a-9f006ec385b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:27.956529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf2adc-8d45-419a-858a-9f006ec385b7 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:27.956988 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf2adc-8d45-419a-858a-9f006ec385b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:27.957381 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf2adc-8d45-419a-858a-9f006ec385b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:27.976007 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf2adc-8d45-419a-858a-9f006ec385b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:27.980878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf2adc-8d45-419a-858a-9f006ec385b7 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:27.991741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab9443-04c7-4214-a480-7b22bd33ffb0 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:27.995172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b2ab9443-04c7-4214-a480-7b22bd33ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:28.002286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 838/1674] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:28.165811 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab9443-04c7-4214-a480-7b22bd33ffb0 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:28.172941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:28.175401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:28.175869 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:28.176550 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] PATH_INFO: `/v3/projects/9cde6305f2314096a95ffce5562f3845` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:28.178049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cde6305f2314096a95ffce5562f3845)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:28.181675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:28.268804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf2adc-8d45-419a-858a-9f006ec385b7 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:28.271633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-fbaf2adc-8d45-419a-858a-9f006ec385b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:28.287179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cde6305f2314096a95ffce5562f3845', 'request_id': 'req-e6366562-9659-42a5-99b7-8ab36a871c36'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:28.293764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf2adc-8d45-419a-858a-9f006ec385b7 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:28.306645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cde6305f2314096a95ffce5562f3845', 'request_id': 'req-e6366562-9659-42a5-99b7-8ab36a871c36'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:28.315928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cde6305f2314096a95ffce5562f3845', 'request_id': 'req-e6366562-9659-42a5-99b7-8ab36a871c36'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:28.337357 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] The token cache is being invalidate because project 9cde6305f2314096a95ffce5562f3845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:28.339236 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:28.340471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e6366562-9659-42a5-99b7-8ab36a871c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:28.350814 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 837/1675] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:27 2022] DELETE /identity/v3/projects/9cde6305f2314096a95ffce5562f3845 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:28.353223 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900c50-ddcf-4cbe-872b-f9d8e3a31569 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:28.353723 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900c50-ddcf-4cbe-872b-f9d8e3a31569 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:28.354155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900c50-ddcf-4cbe-872b-f9d8e3a31569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:28.407860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ca900c50-ddcf-4cbe-872b-f9d8e3a31569 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:28.409754 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ca900c50-ddcf-4cbe-872b-f9d8e3a31569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:28.432075 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:28.434513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:28.435005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:28.435461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] PATH_INFO: `/v3/projects/5a40b20d526747fdb4ac458d256575e3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:28.437119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a40b20d526747fdb4ac458d256575e3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:28.438414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: WARNING py.warnings [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:50:28.438414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: warnings.warn(msg) Jan 24 16:50:28.438414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: Jan 24 16:50:28.441924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:28.491218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 838/1676] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:28.499900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844671-abae-485d-8501-9bbcd896b85e None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:28.500290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844671-abae-485d-8501-9bbcd896b85e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:28.500670 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844671-abae-485d-8501-9bbcd896b85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:28.540317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-bc844671-abae-485d-8501-9bbcd896b85e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:28.542998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-bc844671-abae-485d-8501-9bbcd896b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:28.610022 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a40b20d526747fdb4ac458d256575e3', 'request_id': 'req-b4a31107-c60c-4e66-812f-c78f9f0e2011'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:28.638086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a40b20d526747fdb4ac458d256575e3', 'request_id': 'req-b4a31107-c60c-4e66-812f-c78f9f0e2011'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:28.662412 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a40b20d526747fdb4ac458d256575e3', 'request_id': 'req-b4a31107-c60c-4e66-812f-c78f9f0e2011'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:28.690653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] The token cache is being invalidate because project 5a40b20d526747fdb4ac458d256575e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:28.691047 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:28.691659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b4a31107-c60c-4e66-812f-c78f9f0e2011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:28.694149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 839/1677] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:28 2022] DELETE /identity/v3/projects/5a40b20d526747fdb4ac458d256575e3 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:28.701230 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e12f4-445f-487c-9db4-136a9d03423f None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:28.701513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e12f4-445f-487c-9db4-136a9d03423f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:28.701926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e12f4-445f-487c-9db4-136a9d03423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:28.757332 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-2b2e12f4-445f-487c-9db4-136a9d03423f None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:28.761366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2b2e12f4-445f-487c-9db4-136a9d03423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:28.777063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 839/1678] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:28.784408 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc844671-abae-485d-8501-9bbcd896b85e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:28.820888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc844671-abae-485d-8501-9bbcd896b85e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:28.843579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffbc3-45c6-4f15-ae5a-d59892d66edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:28.844420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffbc3-45c6-4f15-ae5a-d59892d66edf admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:28.848733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffbc3-45c6-4f15-ae5a-d59892d66edf admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:28.849856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffbc3-45c6-4f15-ae5a-d59892d66edf admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:28.850855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ffbc3-45c6-4f15-ae5a-d59892d66edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:28.851353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ffbc3-45c6-4f15-ae5a-d59892d66edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:28.853108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ffbc3-45c6-4f15-ae5a-d59892d66edf admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:28.918930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 840/1679] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:28.920284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffbc3-45c6-4f15-ae5a-d59892d66edf admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:28.961672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffbc3-45c6-4f15-ae5a-d59892d66edf admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:28.986272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80957366-6143-4ced-9f62-83ed9d72aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:28.986984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957366-6143-4ced-9f62-83ed9d72aeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:28.987266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957366-6143-4ced-9f62-83ed9d72aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:28.987627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957366-6143-4ced-9f62-83ed9d72aeb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:28.988483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80957366-6143-4ced-9f62-83ed9d72aeb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:28.990487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80957366-6143-4ced-9f62-83ed9d72aeb1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:28.993160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 840/1680] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:29.005354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffec62-3de2-40ad-b6ac-99b6d87241dd None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:29.015923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffec62-3de2-40ad-b6ac-99b6d87241dd None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:29.016287 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffec62-3de2-40ad-b6ac-99b6d87241dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:29.051491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 841/1681] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:28 2022] POST /identity/v3/projects => generated 376 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:29.053056 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80957366-6143-4ced-9f62-83ed9d72aeb1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:29.057634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-76ffec62-3de2-40ad-b6ac-99b6d87241dd None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:29.059645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-76ffec62-3de2-40ad-b6ac-99b6d87241dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:29.175526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80957366-6143-4ced-9f62-83ed9d72aeb1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:29.190843 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83e1bc-e656-4270-9b8f-505ea7bc9861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:29.193478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83e1bc-e656-4270-9b8f-505ea7bc9861 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:29.194705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 841/1682] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:29.194972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83e1bc-e656-4270-9b8f-505ea7bc9861 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:29.195205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83e1bc-e656-4270-9b8f-505ea7bc9861 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:29.199751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffec62-3de2-40ad-b6ac-99b6d87241dd None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:29.201880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83e1bc-e656-4270-9b8f-505ea7bc9861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:29.204382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83e1bc-e656-4270-9b8f-505ea7bc9861 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:29.212589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffec62-3de2-40ad-b6ac-99b6d87241dd None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:29.219864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbec3cd-28fb-454c-8e80-26decd96f8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:29.221317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbec3cd-28fb-454c-8e80-26decd96f8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:29.221680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbec3cd-28fb-454c-8e80-26decd96f8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:29.222027 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbec3cd-28fb-454c-8e80-26decd96f8b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:29.223418 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbec3cd-28fb-454c-8e80-26decd96f8b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:29.223767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbec3cd-28fb-454c-8e80-26decd96f8b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:29.227599 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbec3cd-28fb-454c-8e80-26decd96f8b6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:29.246800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 842/1683] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:29.249465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbec3cd-28fb-454c-8e80-26decd96f8b6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:29.256138 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 842/1684] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:29 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:50:29.257064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83e1bc-e656-4270-9b8f-505ea7bc9861 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:29.270132 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbec3cd-28fb-454c-8e80-26decd96f8b6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:29.280948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de69d7f-7c3a-4db4-847e-edc5591621f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:29.282071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de69d7f-7c3a-4db4-847e-edc5591621f7 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:29.282627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de69d7f-7c3a-4db4-847e-edc5591621f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:29.283195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de69d7f-7c3a-4db4-847e-edc5591621f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:29.284178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de69d7f-7c3a-4db4-847e-edc5591621f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:29.286805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de69d7f-7c3a-4db4-847e-edc5591621f7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:29.288458 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83e1bc-e656-4270-9b8f-505ea7bc9861 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:29.300338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b8d7-e0b7-4ab9-a605-e6e049d923e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:29.301189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b8d7-e0b7-4ab9-a605-e6e049d923e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:29.302207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b8d7-e0b7-4ab9-a605-e6e049d923e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:29.302207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b8d7-e0b7-4ab9-a605-e6e049d923e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:29.304357 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11b8d7-e0b7-4ab9-a605-e6e049d923e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:29.309905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11b8d7-e0b7-4ab9-a605-e6e049d923e3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:29.341835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 843/1685] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:29 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:29.343166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b8d7-e0b7-4ab9-a605-e6e049d923e3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:29.348706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 843/1686] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:29 2022] POST /identity/v3/projects => generated 364 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:29.355809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de69d7f-7c3a-4db4-847e-edc5591621f7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:29.380888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b8d7-e0b7-4ab9-a605-e6e049d923e3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:29.580611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e16e68-87b7-44d2-97b8-42bfa230a6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:29.581240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16e68-87b7-44d2-97b8-42bfa230a6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:29.581516 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16e68-87b7-44d2-97b8-42bfa230a6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:29.581793 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16e68-87b7-44d2-97b8-42bfa230a6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:29.582545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e16e68-87b7-44d2-97b8-42bfa230a6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:29.584369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e16e68-87b7-44d2-97b8-42bfa230a6a5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:29.608733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 844/1687] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:29 2022] GET /identity/v3/roles => generated 1427 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:29.615470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e16e68-87b7-44d2-97b8-42bfa230a6a5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:29.642439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e16e68-87b7-44d2-97b8-42bfa230a6a5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:29.653607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de69d7f-7c3a-4db4-847e-edc5591621f7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:29.661292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070c7ce-2a0e-4356-a413-f6aa2dfd7f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:29.667269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070c7ce-2a0e-4356-a413-f6aa2dfd7f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:29.667648 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070c7ce-2a0e-4356-a413-f6aa2dfd7f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:29.667924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070c7ce-2a0e-4356-a413-f6aa2dfd7f23 admin admin] PATH_INFO: `/v3/projects/d617e0934788431085bebde1cec5dc02/users/bac2a1fbf49a4ed88a7a749a047c920c/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:29.681789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b87a3-2c5d-4ef4-a056-0d73f2d2e496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:29.681789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b87a3-2c5d-4ef4-a056-0d73f2d2e496 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:29.683513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b87a3-2c5d-4ef4-a056-0d73f2d2e496 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:29.687316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b87a3-2c5d-4ef4-a056-0d73f2d2e496 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:29.693776 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b87a3-2c5d-4ef4-a056-0d73f2d2e496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:29.704082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b87a3-2c5d-4ef4-a056-0d73f2d2e496 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:29.708852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070c7ce-2a0e-4356-a413-f6aa2dfd7f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d617e0934788431085bebde1cec5dc02, user_id=bac2a1fbf49a4ed88a7a749a047c920c, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:29.711978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070c7ce-2a0e-4356-a413-f6aa2dfd7f23 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:29.759629 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 845/1688] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:29 2022] PUT /identity/v3/projects/d617e0934788431085bebde1cec5dc02/users/bac2a1fbf49a4ed88a7a749a047c920c/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:29.763008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e1e93-2384-4dce-a8ef-dcc8d26eb113 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:29.763008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e1e93-2384-4dce-a8ef-dcc8d26eb113 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:29.763008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e1e93-2384-4dce-a8ef-dcc8d26eb113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:29.789063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 844/1689] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:29 2022] POST /identity/v3/users => generated 283 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:29.790820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b87a3-2c5d-4ef4-a056-0d73f2d2e496 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:29.830531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b87a3-2c5d-4ef4-a056-0d73f2d2e496 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:29.832336 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e53e1e93-2384-4dce-a8ef-dcc8d26eb113 None None] MFA Rules not processed for user `bac2a1fbf49a4ed88a7a749a047c920c`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:29.833873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e53e1e93-2384-4dce-a8ef-dcc8d26eb113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:29.983109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 846/1690] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:30.004261 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e1e93-2384-4dce-a8ef-dcc8d26eb113 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:30.054042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da616fce-de2f-46eb-b361-ff950bb47e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:30.056145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da616fce-de2f-46eb-b361-ff950bb47e57 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:30.057184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da616fce-de2f-46eb-b361-ff950bb47e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:30.057644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da616fce-de2f-46eb-b361-ff950bb47e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:30.060593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da616fce-de2f-46eb-b361-ff950bb47e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:30.063953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da616fce-de2f-46eb-b361-ff950bb47e57 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:30.096209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 845/1691] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:29 2022] GET /identity/v3/roles => generated 1427 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:30.097337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da616fce-de2f-46eb-b361-ff950bb47e57 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:30.121912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da616fce-de2f-46eb-b361-ff950bb47e57 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:30.135647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49bf39-eb8a-4962-963f-b32ab72b27e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:30.136777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bf39-eb8a-4962-963f-b32ab72b27e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:30.137236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bf39-eb8a-4962-963f-b32ab72b27e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:30.137787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bf39-eb8a-4962-963f-b32ab72b27e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:30.138714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49bf39-eb8a-4962-963f-b32ab72b27e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:30.140721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49bf39-eb8a-4962-963f-b32ab72b27e1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:30.187634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 846/1692] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:30 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:30.194240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49bf39-eb8a-4962-963f-b32ab72b27e1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:30.239959 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49bf39-eb8a-4962-963f-b32ab72b27e1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:30.249764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6357a-8273-4521-a4fc-df03a67d2bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:30.254456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6357a-8273-4521-a4fc-df03a67d2bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:30.254807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6357a-8273-4521-a4fc-df03a67d2bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:30.255095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6357a-8273-4521-a4fc-df03a67d2bb5 admin admin] PATH_INFO: `/v3/projects/53b0af9d76f1451e9c62fa41e93460c9/users/9b84d6580e1d45dca28cefef47b1b693/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:30.306060 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e1e93-2384-4dce-a8ef-dcc8d26eb113 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:30.307383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6357a-8273-4521-a4fc-df03a67d2bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b0af9d76f1451e9c62fa41e93460c9, user_id=9b84d6580e1d45dca28cefef47b1b693, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:30.320464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6357a-8273-4521-a4fc-df03a67d2bb5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:30.324004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8c9c4-9241-4e90-92ac-dc4ae51ee213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:30.327640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c9c4-9241-4e90-92ac-dc4ae51ee213 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:30.327926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c9c4-9241-4e90-92ac-dc4ae51ee213 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:30.328200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c9c4-9241-4e90-92ac-dc4ae51ee213 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:30.329284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8c9c4-9241-4e90-92ac-dc4ae51ee213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:30.337789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8c9c4-9241-4e90-92ac-dc4ae51ee213 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:30.362805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 847/1693] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:30 2022] PUT /identity/v3/projects/53b0af9d76f1451e9c62fa41e93460c9/users/9b84d6580e1d45dca28cefef47b1b693/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:30.382026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e3f6-b7c1-452a-9665-f56b03c7d841 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:30.382441 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e3f6-b7c1-452a-9665-f56b03c7d841 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:30.382646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e3f6-b7c1-452a-9665-f56b03c7d841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:30.423279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 847/1694] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:29 2022] POST /identity/v3/projects => generated 380 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:30.425901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8c9c4-9241-4e90-92ac-dc4ae51ee213 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:30.500221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-0739e3f6-b7c1-452a-9665-f56b03c7d841 None None] MFA Rules not processed for user `9b84d6580e1d45dca28cefef47b1b693`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:30.501610 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-0739e3f6-b7c1-452a-9665-f56b03c7d841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:30.547279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8c9c4-9241-4e90-92ac-dc4ae51ee213 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:30.560113 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5642d-8310-48b0-aec5-9b51f144e9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:30.562660 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5642d-8310-48b0-aec5-9b51f144e9cc admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:30.564963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5642d-8310-48b0-aec5-9b51f144e9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:30.565847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5642d-8310-48b0-aec5-9b51f144e9cc admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:30.566632 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5642d-8310-48b0-aec5-9b51f144e9cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:30.573728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5642d-8310-48b0-aec5-9b51f144e9cc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:30.617587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 848/1695] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:30 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:30.626394 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5642d-8310-48b0-aec5-9b51f144e9cc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:30.645762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5642d-8310-48b0-aec5-9b51f144e9cc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:30.652359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612138-5e2e-4aa0-a89a-e9eacf36bf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:30.653028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612138-5e2e-4aa0-a89a-e9eacf36bf8c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:30.653365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612138-5e2e-4aa0-a89a-e9eacf36bf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:30.653649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612138-5e2e-4aa0-a89a-e9eacf36bf8c admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:30.655923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3612138-5e2e-4aa0-a89a-e9eacf36bf8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:30.657805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3612138-5e2e-4aa0-a89a-e9eacf36bf8c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:30.692152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 849/1696] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:30 2022] GET /identity/v3/roles => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:30.693786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612138-5e2e-4aa0-a89a-e9eacf36bf8c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:30.713692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612138-5e2e-4aa0-a89a-e9eacf36bf8c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:30.736135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacf5ca-b4ff-4f81-925a-c1eda82ed680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:30.736749 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacf5ca-b4ff-4f81-925a-c1eda82ed680 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:30.737029 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacf5ca-b4ff-4f81-925a-c1eda82ed680 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:30.737432 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacf5ca-b4ff-4f81-925a-c1eda82ed680 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:30.738339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacf5ca-b4ff-4f81-925a-c1eda82ed680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:30.740279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacf5ca-b4ff-4f81-925a-c1eda82ed680 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:30.768916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 850/1697] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:30 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:30.773238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacf5ca-b4ff-4f81-925a-c1eda82ed680 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:30.783562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 848/1698] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:30.784488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739e3f6-b7c1-452a-9665-f56b03c7d841 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:30.784734 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacf5ca-b4ff-4f81-925a-c1eda82ed680 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:30.794689 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdbc92-6f8e-4abe-b155-178e5fdfeaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:30.795972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdbc92-6f8e-4abe-b155-178e5fdfeaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:30.796256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdbc92-6f8e-4abe-b155-178e5fdfeaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:30.796624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdbc92-6f8e-4abe-b155-178e5fdfeaa4 admin admin] PATH_INFO: `/v3/projects/a085225b930d472fa4d9f1bf5cef6177/users/08e28d21c52d404ca714fa77c0a1a41e/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:30.826106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739e3f6-b7c1-452a-9665-f56b03c7d841 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:30.829494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdbc92-6f8e-4abe-b155-178e5fdfeaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a085225b930d472fa4d9f1bf5cef6177, user_id=08e28d21c52d404ca714fa77c0a1a41e, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:30.835226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdbc92-6f8e-4abe-b155-178e5fdfeaa4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:30.840784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440f4a2-8046-4a3d-a599-e4b8adea71db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:30.841656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440f4a2-8046-4a3d-a599-e4b8adea71db admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:30.841797 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440f4a2-8046-4a3d-a599-e4b8adea71db admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:30.847497 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440f4a2-8046-4a3d-a599-e4b8adea71db admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:30.861899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440f4a2-8046-4a3d-a599-e4b8adea71db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:30.871244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440f4a2-8046-4a3d-a599-e4b8adea71db admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:30.872890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 851/1699] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:30 2022] PUT /identity/v3/projects/a085225b930d472fa4d9f1bf5cef6177/users/08e28d21c52d404ca714fa77c0a1a41e/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:30.875683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd2e31-fdde-40ad-88b2-ce3147f3a594 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:30.877305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd2e31-fdde-40ad-88b2-ce3147f3a594 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:30.877305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd2e31-fdde-40ad-88b2-ce3147f3a594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:30.938566 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 849/1700] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:30 2022] POST /identity/v3/projects => generated 366 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:30.940934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7bcd2e31-fdde-40ad-88b2-ce3147f3a594 None None] MFA Rules not processed for user `08e28d21c52d404ca714fa77c0a1a41e`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:30.942221 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7bcd2e31-fdde-40ad-88b2-ce3147f3a594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:30.942831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440f4a2-8046-4a3d-a599-e4b8adea71db admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:31.075070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440f4a2-8046-4a3d-a599-e4b8adea71db admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:31.081195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83519b-dff5-4152-a42f-9451094bd57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:31.082484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83519b-dff5-4152-a42f-9451094bd57d admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:31.083044 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83519b-dff5-4152-a42f-9451094bd57d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:31.083957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83519b-dff5-4152-a42f-9451094bd57d admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:31.085077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83519b-dff5-4152-a42f-9451094bd57d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:31.089171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83519b-dff5-4152-a42f-9451094bd57d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:31.094214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 852/1701] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:31.094714 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd2e31-fdde-40ad-88b2-ce3147f3a594 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:31.115404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd2e31-fdde-40ad-88b2-ce3147f3a594 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:31.129510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521601f-ba6a-493b-9180-9cac019d91c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:31.130410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521601f-ba6a-493b-9180-9cac019d91c8 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:31.130897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521601f-ba6a-493b-9180-9cac019d91c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:31.131328 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521601f-ba6a-493b-9180-9cac019d91c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:31.136994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 850/1702] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:30 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:31.138089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521601f-ba6a-493b-9180-9cac019d91c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:31.138200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83519b-dff5-4152-a42f-9451094bd57d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:31.146200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521601f-ba6a-493b-9180-9cac019d91c8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:31.174369 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83519b-dff5-4152-a42f-9451094bd57d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:31.194467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c84f8-775c-4302-a041-a0fd8d60aad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:31.196281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c84f8-775c-4302-a041-a0fd8d60aad7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:31.196630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c84f8-775c-4302-a041-a0fd8d60aad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:31.199407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c84f8-775c-4302-a041-a0fd8d60aad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:31.201671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c84f8-775c-4302-a041-a0fd8d60aad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:31.205521 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c84f8-775c-4302-a041-a0fd8d60aad7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:31.206746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 853/1703] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:31 2022] POST /identity/v3/projects => generated 378 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:31.211025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521601f-ba6a-493b-9180-9cac019d91c8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:31.237289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 851/1704] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:31 2022] GET /identity/v3/roles => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:31.238718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c84f8-775c-4302-a041-a0fd8d60aad7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:31.268014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c84f8-775c-4302-a041-a0fd8d60aad7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:31.344933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521601f-ba6a-493b-9180-9cac019d91c8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:31.355749 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d651074-e68e-40e0-9c22-51661a5fb32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:31.356867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651074-e68e-40e0-9c22-51661a5fb32c admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:31.356867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651074-e68e-40e0-9c22-51661a5fb32c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:31.357039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651074-e68e-40e0-9c22-51661a5fb32c admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:31.357792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d651074-e68e-40e0-9c22-51661a5fb32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:31.361048 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d651074-e68e-40e0-9c22-51661a5fb32c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:31.362978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b889d-9b6f-424e-8e22-844ee06c0316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:31.364137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b889d-9b6f-424e-8e22-844ee06c0316 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:31.364580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b889d-9b6f-424e-8e22-844ee06c0316 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:31.365435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b889d-9b6f-424e-8e22-844ee06c0316 admin admin] PATH_INFO: `/v3/projects/27a939817c12402ab99caf97f7403872/users/cf1f04c12a71451280a553b97ed1354e/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:31.389562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b889d-9b6f-424e-8e22-844ee06c0316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a939817c12402ab99caf97f7403872, user_id=cf1f04c12a71451280a553b97ed1354e, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:31.393414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b889d-9b6f-424e-8e22-844ee06c0316 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:31.421601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 852/1705] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:31 2022] PUT /identity/v3/projects/27a939817c12402ab99caf97f7403872/users/cf1f04c12a71451280a553b97ed1354e/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:31.425732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b889d-9b6f-424e-8e22-844ee06c0316 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:31.429257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 854/1706] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:31 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:31.446475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d651074-e68e-40e0-9c22-51661a5fb32c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:31.491739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d651074-e68e-40e0-9c22-51661a5fb32c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:31.558616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b889d-9b6f-424e-8e22-844ee06c0316 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:31.565164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21e167-79cd-4491-bd6f-b8c2ba0e555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:31.566028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21e167-79cd-4491-bd6f-b8c2ba0e555e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:31.566316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21e167-79cd-4491-bd6f-b8c2ba0e555e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:31.566774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21e167-79cd-4491-bd6f-b8c2ba0e555e admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:31.568871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21e167-79cd-4491-bd6f-b8c2ba0e555e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:31.570746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21e167-79cd-4491-bd6f-b8c2ba0e555e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:31.588578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 853/1707] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:31 2022] GET /identity/v3/roles => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:31.592357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21e167-79cd-4491-bd6f-b8c2ba0e555e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:31.617331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21e167-79cd-4491-bd6f-b8c2ba0e555e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:31.626338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc85d3-0347-40ba-80b1-20662cf88a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:31.627767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc85d3-0347-40ba-80b1-20662cf88a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:31.628054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc85d3-0347-40ba-80b1-20662cf88a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:31.628481 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc85d3-0347-40ba-80b1-20662cf88a78 admin admin] PATH_INFO: `/v3/projects/27a939817c12402ab99caf97f7403872/users/cf1f04c12a71451280a553b97ed1354e/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:31.630949 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc85d3-0347-40ba-80b1-20662cf88a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a939817c12402ab99caf97f7403872, user_id=cf1f04c12a71451280a553b97ed1354e, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:31.633744 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc85d3-0347-40ba-80b1-20662cf88a78 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:31.653066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 854/1708] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:31 2022] PUT /identity/v3/projects/27a939817c12402ab99caf97f7403872/users/cf1f04c12a71451280a553b97ed1354e/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:31.654200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc85d3-0347-40ba-80b1-20662cf88a78 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:31.665726 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-18bc85d3-0347-40ba-80b1-20662cf88a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:31.710134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989abcb5-7f22-4196-bdab-87b6e838de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:31.710711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989abcb5-7f22-4196-bdab-87b6e838de93 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:31.710711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989abcb5-7f22-4196-bdab-87b6e838de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:31.711124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989abcb5-7f22-4196-bdab-87b6e838de93 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:31.711975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989abcb5-7f22-4196-bdab-87b6e838de93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:31.714614 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989abcb5-7f22-4196-bdab-87b6e838de93 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:31.737304 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 855/1709] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:31 2022] GET /identity/v3/roles => generated 1427 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:31.739111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ff31-cf04-4478-aaec-832796f2179a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:31.739496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ff31-cf04-4478-aaec-832796f2179a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:31.739841 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ff31-cf04-4478-aaec-832796f2179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:31.800257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e401ff31-cf04-4478-aaec-832796f2179a None None] MFA Rules not processed for user `cf1f04c12a71451280a553b97ed1354e`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:31.802192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e401ff31-cf04-4478-aaec-832796f2179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:31.846584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc85d3-0347-40ba-80b1-20662cf88a78 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:31.858265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:31.859261 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:31.859530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:31.859811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] PATH_INFO: `/v3/users/003057b689524c49b7ef8ea20f3bee63` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:31.861122 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=003057b689524c49b7ef8ea20f3bee63)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:31.870422 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:31.942733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 856/1710] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:31.944381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94368e16-8521-4c9e-a66e-03955dddedea None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:31.944808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94368e16-8521-4c9e-a66e-03955dddedea None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:31.945095 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94368e16-8521-4c9e-a66e-03955dddedea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:31.958545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003057b689524c49b7ef8ea20f3bee63'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:31.976720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-94368e16-8521-4c9e-a66e-03955dddedea None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:31.979262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-94368e16-8521-4c9e-a66e-03955dddedea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:31.989042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003057b689524c49b7ef8ea20f3bee63'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:31.990832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003057b689524c49b7ef8ea20f3bee63'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:31.991512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003057b689524c49b7ef8ea20f3bee63'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:32.014059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003057b689524c49b7ef8ea20f3bee63'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:32.040497 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 855/1711] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:31 2022] DELETE /identity/v3/users/003057b689524c49b7ef8ea20f3bee63 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:32.046407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:32.054119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:32.065779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 857/1712] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:50:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:32.080055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94368e16-8521-4c9e-a66e-03955dddedea None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:32.082242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-94368e16-8521-4c9e-a66e-03955dddedea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:32.221943 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94368e16-8521-4c9e-a66e-03955dddedea None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:32.241704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babf79-e905-4157-9b85-9485dc78b70f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:32.249160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867958ea-4cd6-4f9d-a3c5-d37f7aa43f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:32.250296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867958ea-4cd6-4f9d-a3c5-d37f7aa43f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:32.250578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867958ea-4cd6-4f9d-a3c5-d37f7aa43f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:32.251615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867958ea-4cd6-4f9d-a3c5-d37f7aa43f97 admin admin] PATH_INFO: `/v3/projects/2865df3245944d5c9428758390d4201b/users/c6bc299177fb46d28d5f03d7ce4617a2/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:32.329170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867958ea-4cd6-4f9d-a3c5-d37f7aa43f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2865df3245944d5c9428758390d4201b, user_id=c6bc299177fb46d28d5f03d7ce4617a2, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:32.343954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867958ea-4cd6-4f9d-a3c5-d37f7aa43f97 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:32.347379 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3ced-64d2-4eba-a3b7-15478d340f32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:32.348680 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3ced-64d2-4eba-a3b7-15478d340f32 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:32.348965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3ced-64d2-4eba-a3b7-15478d340f32 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:32.349388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3ced-64d2-4eba-a3b7-15478d340f32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:32.356469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d93e3ced-64d2-4eba-a3b7-15478d340f32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:32.363214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 856/1713] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:32 2022] PUT /identity/v3/projects/2865df3245944d5c9428758390d4201b/users/c6bc299177fb46d28d5f03d7ce4617a2/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:32.364660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c10ae-46fa-421a-8ede-6fd078d62483 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:32.364960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c10ae-46fa-421a-8ede-6fd078d62483 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:32.365239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c10ae-46fa-421a-8ede-6fd078d62483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:32.406155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-732c10ae-46fa-421a-8ede-6fd078d62483 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:32.409637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-732c10ae-46fa-421a-8ede-6fd078d62483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:32.538563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e3ced-64d2-4eba-a3b7-15478d340f32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:32.541878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e3ced-64d2-4eba-a3b7-15478d340f32 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:32.554447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 857/1714] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:32.554871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c10ae-46fa-421a-8ede-6fd078d62483 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:32.562282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 858/1715] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:32.563491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3ced-64d2-4eba-a3b7-15478d340f32 service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:32.567830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d93e3ced-64d2-4eba-a3b7-15478d340f32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:32.573637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c10ae-46fa-421a-8ede-6fd078d62483 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:32.591571 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bdb82-ee4f-4cf0-9bc2-2df244c21ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:32.591780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bdb82-ee4f-4cf0-9bc2-2df244c21ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:32.592006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bdb82-ee4f-4cf0-9bc2-2df244c21ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:32.592274 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bdb82-ee4f-4cf0-9bc2-2df244c21ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:32.593230 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bdb82-ee4f-4cf0-9bc2-2df244c21ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:32.594943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bdb82-ee4f-4cf0-9bc2-2df244c21ab8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:32.615947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 858/1716] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:32 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:32.621539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bdb82-ee4f-4cf0-9bc2-2df244c21ab8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:32.636487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bdb82-ee4f-4cf0-9bc2-2df244c21ab8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:32.656773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00f87f-6ddc-47ce-8953-e8c4d5c10951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:32.657683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00f87f-6ddc-47ce-8953-e8c4d5c10951 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:32.657967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00f87f-6ddc-47ce-8953-e8c4d5c10951 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:32.658242 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00f87f-6ddc-47ce-8953-e8c4d5c10951 admin admin] PATH_INFO: `/v3/projects/2865df3245944d5c9428758390d4201b/users/c6bc299177fb46d28d5f03d7ce4617a2/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:32.660562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00f87f-6ddc-47ce-8953-e8c4d5c10951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2865df3245944d5c9428758390d4201b, user_id=c6bc299177fb46d28d5f03d7ce4617a2, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:32.663366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00f87f-6ddc-47ce-8953-e8c4d5c10951 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:32.689626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 859/1717] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:32 2022] PUT /identity/v3/projects/2865df3245944d5c9428758390d4201b/users/c6bc299177fb46d28d5f03d7ce4617a2/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:32.699936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9273f8-d0f2-4279-9600-b96604a3e6eb None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:32.700229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9273f8-d0f2-4279-9600-b96604a3e6eb None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:32.700503 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9273f8-d0f2-4279-9600-b96604a3e6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:32.746051 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4e9273f8-d0f2-4279-9600-b96604a3e6eb None None] MFA Rules not processed for user `c6bc299177fb46d28d5f03d7ce4617a2`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:32.747164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4e9273f8-d0f2-4279-9600-b96604a3e6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:32.773668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3ced-64d2-4eba-a3b7-15478d340f32 service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:32.839145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 860/1718] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:32.840484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9273f8-d0f2-4279-9600-b96604a3e6eb None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:32.842141 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4e9273f8-d0f2-4279-9600-b96604a3e6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:32.872941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942a18e-283f-4d90-b9ae-8338bd0399ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:32.874623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942a18e-283f-4d90-b9ae-8338bd0399ca service swift] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:32.876600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942a18e-283f-4d90-b9ae-8338bd0399ca service swift] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:32.877128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942a18e-283f-4d90-b9ae-8338bd0399ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:32.950793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9273f8-d0f2-4279-9600-b96604a3e6eb None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:32.959727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d21ec-a266-4fa3-8d22-67ad85b2a8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:32.960427 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d21ec-a266-4fa3-8d22-67ad85b2a8dc service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:32.960731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d21ec-a266-4fa3-8d22-67ad85b2a8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:32.960991 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d21ec-a266-4fa3-8d22-67ad85b2a8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:32.997132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942a18e-283f-4d90-b9ae-8338bd0399ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:33.001396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942a18e-283f-4d90-b9ae-8338bd0399ca service swift] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:33.019763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 859/1719] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:50:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:50:33.021663 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942a18e-283f-4d90-b9ae-8338bd0399ca service swift] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:33.099878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d21ec-a266-4fa3-8d22-67ad85b2a8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:33.101271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d21ec-a266-4fa3-8d22-67ad85b2a8dc service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:33.126020 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 861/1720] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:33.129110 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d21ec-a266-4fa3-8d22-67ad85b2a8dc service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:33.137427 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e19d21ec-a266-4fa3-8d22-67ad85b2a8dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:33.147015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942a18e-283f-4d90-b9ae-8338bd0399ca service swift] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:33.160303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0614ac-ca2d-45e6-a374-66cf5fcc9841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:33.161983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0614ac-ca2d-45e6-a374-66cf5fcc9841 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:33.162270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0614ac-ca2d-45e6-a374-66cf5fcc9841 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:33.162570 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0614ac-ca2d-45e6-a374-66cf5fcc9841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:33.167669 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-fd0614ac-ca2d-45e6-a374-66cf5fcc9841 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:33.168889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d21ec-a266-4fa3-8d22-67ad85b2a8dc service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:33.175545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391111a7-006a-413a-8c02-86d1ea51c0ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:33.176210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391111a7-006a-413a-8c02-86d1ea51c0ee service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:33.176489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391111a7-006a-413a-8c02-86d1ea51c0ee service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:33.176825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391111a7-006a-413a-8c02-86d1ea51c0ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:33.207407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391111a7-006a-413a-8c02-86d1ea51c0ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:33.208806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391111a7-006a-413a-8c02-86d1ea51c0ee service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:33.248435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 862/1721] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:33.297458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391111a7-006a-413a-8c02-86d1ea51c0ee service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:33.307598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391111a7-006a-413a-8c02-86d1ea51c0ee service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:33.314894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dba4f-6298-4102-bd4c-8793ecc4cebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:33.316395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dba4f-6298-4102-bd4c-8793ecc4cebe service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:33.318640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dba4f-6298-4102-bd4c-8793ecc4cebe service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:33.321786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dba4f-6298-4102-bd4c-8793ecc4cebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:33.327382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f03dba4f-6298-4102-bd4c-8793ecc4cebe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:33.332946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0614ac-ca2d-45e6-a374-66cf5fcc9841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:33.335080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0614ac-ca2d-45e6-a374-66cf5fcc9841 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:33.357331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 860/1722] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:33.408708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03dba4f-6298-4102-bd4c-8793ecc4cebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:33.410804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03dba4f-6298-4102-bd4c-8793ecc4cebe service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:33.434649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 863/1723] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:33.866018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717fc9-bf4e-437f-8725-4a2463c72b5e None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:33.866612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717fc9-bf4e-437f-8725-4a2463c72b5e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:33.866847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717fc9-bf4e-437f-8725-4a2463c72b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:33.903861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d3717fc9-bf4e-437f-8725-4a2463c72b5e None None] MFA Rules not processed for user `50e012c5fcde4462984a57878629fd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:33.908103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d3717fc9-bf4e-437f-8725-4a2463c72b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:34.146208 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 861/1724] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:36.781765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb99f4-a828-4297-859a-4977ea9cda92 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:36.781765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb99f4-a828-4297-859a-4977ea9cda92 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:36.782434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb99f4-a828-4297-859a-4977ea9cda92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:36.827339 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-e4fb99f4-a828-4297-859a-4977ea9cda92 None None] MFA Rules not processed for user `aa9834b75e2b4ac787f3917564090d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:36.830271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e4fb99f4-a828-4297-859a-4977ea9cda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:36.868144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 864/1725] 10.222.0.79 () {58 vars in 1019 bytes} [Mon Jan 24 16:50:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:37.097313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3717fc9-bf4e-437f-8725-4a2463c72b5e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:37.109799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3717fc9-bf4e-437f-8725-4a2463c72b5e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:37.121807 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c388f-fa0d-414b-a810-037a63d19ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:37.122475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c388f-fa0d-414b-a810-037a63d19ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:37.124432 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c388f-fa0d-414b-a810-037a63d19ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:37.126935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c388f-fa0d-414b-a810-037a63d19ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:37.174369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c388f-fa0d-414b-a810-037a63d19ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:37.176128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c388f-fa0d-414b-a810-037a63d19ad4 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:37.222198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 862/1726] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:37.486515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb99f4-a828-4297-859a-4977ea9cda92 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:37.521489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb99f4-a828-4297-859a-4977ea9cda92 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:37.545337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:37.558985 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:37.559276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:37.559564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] PATH_INFO: `/v3/users/bac2a1fbf49a4ed88a7a749a047c920c` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:37.569262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac2a1fbf49a4ed88a7a749a047c920c)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:37.580442 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:37.731053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c388f-fa0d-414b-a810-037a63d19ad4 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:37.732779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d30c388f-fa0d-414b-a810-037a63d19ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:37.786290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac2a1fbf49a4ed88a7a749a047c920c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:37.791782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c388f-fa0d-414b-a810-037a63d19ad4 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:37.830331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5985d5-3b01-4e71-89fb-f84076783a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:37.831181 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5985d5-3b01-4e71-89fb-f84076783a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:37.831464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5985d5-3b01-4e71-89fb-f84076783a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:37.831778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5985d5-3b01-4e71-89fb-f84076783a1a admin admin] PATH_INFO: `/v3/users/9b84d6580e1d45dca28cefef47b1b693` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:37.840754 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5985d5-3b01-4e71-89fb-f84076783a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b84d6580e1d45dca28cefef47b1b693)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:37.842876 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5985d5-3b01-4e71-89fb-f84076783a1a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:37.864986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac2a1fbf49a4ed88a7a749a047c920c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:37.871204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac2a1fbf49a4ed88a7a749a047c920c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:37.878557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac2a1fbf49a4ed88a7a749a047c920c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:37.907244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac2a1fbf49a4ed88a7a749a047c920c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:37.950303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 865/1727] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:37 2022] DELETE /identity/v3/users/bac2a1fbf49a4ed88a7a749a047c920c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:37.951216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:37.959972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:38.020995 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4c5985d5-3b01-4e71-89fb-f84076783a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b84d6580e1d45dca28cefef47b1b693'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:38.041602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4c5985d5-3b01-4e71-89fb-f84076783a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b84d6580e1d45dca28cefef47b1b693'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:38.076149 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4c5985d5-3b01-4e71-89fb-f84076783a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b84d6580e1d45dca28cefef47b1b693'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:38.117734 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4c5985d5-3b01-4e71-89fb-f84076783a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b84d6580e1d45dca28cefef47b1b693'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:38.131797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4c5985d5-3b01-4e71-89fb-f84076783a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b84d6580e1d45dca28cefef47b1b693'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:38.167092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 863/1728] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:37 2022] DELETE /identity/v3/users/9b84d6580e1d45dca28cefef47b1b693 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:38.174002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f39d9-3169-4a09-a824-04d30ac3a6cd None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:38.174288 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f39d9-3169-4a09-a824-04d30ac3a6cd None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:38.174568 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f39d9-3169-4a09-a824-04d30ac3a6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:38.217312 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469054d-f2ab-49a3-9892-beac594013fe admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:38.224523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-6b2f39d9-3169-4a09-a824-04d30ac3a6cd None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:38.230103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-6b2f39d9-3169-4a09-a824-04d30ac3a6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:38.422141 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:38.422654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 864/1729] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:38.424337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff5eb-3444-468a-ab90-3ba5b3cbabb5 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:38.425384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:38.425854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:38.426278 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff5eb-3444-468a-ab90-3ba5b3cbabb5 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:38.427056 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] PATH_INFO: `/v3/projects/b66cbb5472e744d084d67cd91d835d10` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:38.427185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff5eb-3444-468a-ab90-3ba5b3cbabb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:38.430173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66cbb5472e744d084d67cd91d835d10)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:38.434414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:38.469656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e4eff5eb-3444-468a-ab90-3ba5b3cbabb5 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:38.471836 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e4eff5eb-3444-468a-ab90-3ba5b3cbabb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:38.502197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 865/1730] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:38.502197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434899a8-9e1f-4aa4-9ee6-af1e76ef5f23 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:38.502197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434899a8-9e1f-4aa4-9ee6-af1e76ef5f23 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:38.502197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434899a8-9e1f-4aa4-9ee6-af1e76ef5f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:38.539979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66cbb5472e744d084d67cd91d835d10', 'request_id': 'req-2e8cdb24-270b-465b-b575-b274d066168b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:38.548418 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-434899a8-9e1f-4aa4-9ee6-af1e76ef5f23 None None] MFA Rules not processed for user `edb10d68444a4c6e947c1e356987736f`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:38.550109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-434899a8-9e1f-4aa4-9ee6-af1e76ef5f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:38.559791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66cbb5472e744d084d67cd91d835d10', 'request_id': 'req-2e8cdb24-270b-465b-b575-b274d066168b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:38.569061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66cbb5472e744d084d67cd91d835d10', 'request_id': 'req-2e8cdb24-270b-465b-b575-b274d066168b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:38.585354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] The token cache is being invalidate because project b66cbb5472e744d084d67cd91d835d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:38.585645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:38.588243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:38.590361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 866/1731] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:37 2022] DELETE /identity/v3/projects/b66cbb5472e744d084d67cd91d835d10 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:38.593071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:38.600046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:38.703880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 866/1732] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:38.703880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434899a8-9e1f-4aa4-9ee6-af1e76ef5f23 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:38.703880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-434899a8-9e1f-4aa4-9ee6-af1e76ef5f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:38.791240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cdb24-270b-465b-b575-b274d066168b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:38.809702 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697bd59-1e94-45bc-b120-e43e3eabfdcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:38.810376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697bd59-1e94-45bc-b120-e43e3eabfdcb service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:38.810666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697bd59-1e94-45bc-b120-e43e3eabfdcb service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:38.811074 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697bd59-1e94-45bc-b120-e43e3eabfdcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:38.812956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6697bd59-1e94-45bc-b120-e43e3eabfdcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:38.827883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434899a8-9e1f-4aa4-9ee6-af1e76ef5f23 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:38.848752 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336526b1-cfaa-4ed4-a4cc-1278b2dc6ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:38.849418 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336526b1-cfaa-4ed4-a4cc-1278b2dc6ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:38.849786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336526b1-cfaa-4ed4-a4cc-1278b2dc6ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:38.849991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336526b1-cfaa-4ed4-a4cc-1278b2dc6ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:38.852899 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-336526b1-cfaa-4ed4-a4cc-1278b2dc6ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:38.896345 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697bd59-1e94-45bc-b120-e43e3eabfdcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:38.898700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697bd59-1e94-45bc-b120-e43e3eabfdcb service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:38.914973 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 867/1733] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:38.916348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c47d6-7a7c-439d-848b-68933b07aecb None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:38.917100 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c47d6-7a7c-439d-848b-68933b07aecb None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:38.917100 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c47d6-7a7c-439d-848b-68933b07aecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:38.940990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b33c47d6-7a7c-439d-848b-68933b07aecb None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:38.943341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b33c47d6-7a7c-439d-848b-68933b07aecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:38.985996 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 868/1734] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:38.987419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c47d6-7a7c-439d-848b-68933b07aecb None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:38.991406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b33c47d6-7a7c-439d-848b-68933b07aecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:39.060732 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336526b1-cfaa-4ed4-a4cc-1278b2dc6ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:39.062288 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336526b1-cfaa-4ed4-a4cc-1278b2dc6ea9 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:39.090329 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 867/1735] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:39.092879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de9083-e3ae-4fd0-83bf-c646e0c4f52c None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:39.092879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de9083-e3ae-4fd0-83bf-c646e0c4f52c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:39.092879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de9083-e3ae-4fd0-83bf-c646e0c4f52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:39.161568 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-c0de9083-e3ae-4fd0-83bf-c646e0c4f52c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:39.162212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c0de9083-e3ae-4fd0-83bf-c646e0c4f52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:39.189169 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 868/1736] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:39.190153 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de9083-e3ae-4fd0-83bf-c646e0c4f52c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:39.212240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c47d6-7a7c-439d-848b-68933b07aecb None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:39.214820 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de9083-e3ae-4fd0-83bf-c646e0c4f52c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:39.226967 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827917a-0f3a-43e7-98cd-c5469451a43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:39.227826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d6499-1b4a-4eb1-a5e6-b4c385ec75f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:39.228403 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827917a-0f3a-43e7-98cd-c5469451a43b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:39.229062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6499-1b4a-4eb1-a5e6-b4c385ec75f8 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:39.229627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6499-1b4a-4eb1-a5e6-b4c385ec75f8 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:39.229881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6499-1b4a-4eb1-a5e6-b4c385ec75f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:39.230271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827917a-0f3a-43e7-98cd-c5469451a43b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:39.230786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827917a-0f3a-43e7-98cd-c5469451a43b admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:39.231857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827917a-0f3a-43e7-98cd-c5469451a43b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:39.232318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827917a-0f3a-43e7-98cd-c5469451a43b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:39.234318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827917a-0f3a-43e7-98cd-c5469451a43b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:39.252888 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d6499-1b4a-4eb1-a5e6-b4c385ec75f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:39.253463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 869/1737] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:39.254172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d6499-1b4a-4eb1-a5e6-b4c385ec75f8 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:39.254769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827917a-0f3a-43e7-98cd-c5469451a43b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:39.272321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827917a-0f3a-43e7-98cd-c5469451a43b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:39.283483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa3f4f-9196-46e2-bf1e-ee655fd77ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:39.285388 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 869/1738] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:39.285990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3f4f-9196-46e2-bf1e-ee655fd77ddf admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:39.286695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3f4f-9196-46e2-bf1e-ee655fd77ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:39.287337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3f4f-9196-46e2-bf1e-ee655fd77ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:39.288684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa3f4f-9196-46e2-bf1e-ee655fd77ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:39.294342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa3f4f-9196-46e2-bf1e-ee655fd77ddf admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:39.341703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 870/1739] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:39 2022] POST /identity/v3/projects => generated 406 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:39.342209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d6499-1b4a-4eb1-a5e6-b4c385ec75f8 service nova] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:39.359445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d6499-1b4a-4eb1-a5e6-b4c385ec75f8 service nova] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:39.497003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a719666-4811-4532-9559-4b9d1b120540 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:39.497376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a719666-4811-4532-9559-4b9d1b120540 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:39.497702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a719666-4811-4532-9559-4b9d1b120540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:39.617259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47ce00-df37-4bcd-bf66-1c660467e78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:39.621081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ce00-df37-4bcd-bf66-1c660467e78c admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:39.624600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ce00-df37-4bcd-bf66-1c660467e78c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:39.625046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ce00-df37-4bcd-bf66-1c660467e78c admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:39.627864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-1a719666-4811-4532-9559-4b9d1b120540 None None] MFA Rules not processed for user `f86b459cc02f4f38a2ced5f25972535f`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:39.629101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1a719666-4811-4532-9559-4b9d1b120540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:39.630182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47ce00-df37-4bcd-bf66-1c660467e78c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:39.635622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47ce00-df37-4bcd-bf66-1c660467e78c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:39.707632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 870/1740] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:39 2022] POST /identity/v3/users => generated 304 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:50:39.713334 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47ce00-df37-4bcd-bf66-1c660467e78c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:39.807272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47ce00-df37-4bcd-bf66-1c660467e78c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:39.837328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6713-e001-42e8-a5a7-f0e5e55ac982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:39.844519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6713-e001-42e8-a5a7-f0e5e55ac982 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:39.847596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6713-e001-42e8-a5a7-f0e5e55ac982 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:39.849743 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6713-e001-42e8-a5a7-f0e5e55ac982 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:39.856858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b6713-e001-42e8-a5a7-f0e5e55ac982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:39.860348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b6713-e001-42e8-a5a7-f0e5e55ac982 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:39.933776 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 871/1741] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:39 2022] GET /identity/v3/roles => generated 1427 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:39.956597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6713-e001-42e8-a5a7-f0e5e55ac982 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:39.956800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 871/1742] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:39.958685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b851d-046b-4921-ab21-faf2318bab69 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:39.959040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b851d-046b-4921-ab21-faf2318bab69 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:39.959319 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b851d-046b-4921-ab21-faf2318bab69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:40.008245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6713-e001-42e8-a5a7-f0e5e55ac982 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:40.032586 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-398b851d-046b-4921-ab21-faf2318bab69 None None] MFA Rules not processed for user `f86b459cc02f4f38a2ced5f25972535f`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:40.033783 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-398b851d-046b-4921-ab21-faf2318bab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:40.048310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434acf46-d324-4211-9421-66e518ea0ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:40.050975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434acf46-d324-4211-9421-66e518ea0ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:40.051210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 872/1743] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:40.060885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434acf46-d324-4211-9421-66e518ea0ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:40.061247 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434acf46-d324-4211-9421-66e518ea0ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:40.066101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434acf46-d324-4211-9421-66e518ea0ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:40.080592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434acf46-d324-4211-9421-66e518ea0ae1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:40.130917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 872/1744] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:39 2022] GET /identity/v3/roles => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:40.135099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b851d-046b-4921-ab21-faf2318bab69 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:40.156549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b851d-046b-4921-ab21-faf2318bab69 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:40.178796 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2931d-cb5b-43f5-9bdd-b184885ff361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:40.179771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2931d-cb5b-43f5-9bdd-b184885ff361 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:40.180074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2931d-cb5b-43f5-9bdd-b184885ff361 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:40.180347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2931d-cb5b-43f5-9bdd-b184885ff361 admin admin] PATH_INFO: `/v3/projects/5a25f8bf009e4b55b66d738b6411bdd1/users/b359098928524e869cf3ffe527902ff4/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:40.241456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2931d-cb5b-43f5-9bdd-b184885ff361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a25f8bf009e4b55b66d738b6411bdd1, user_id=b359098928524e869cf3ffe527902ff4, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:40.245123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2931d-cb5b-43f5-9bdd-b184885ff361 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:40.278217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 873/1745] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:40 2022] PUT /identity/v3/projects/5a25f8bf009e4b55b66d738b6411bdd1/users/b359098928524e869cf3ffe527902ff4/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:40.283725 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851886-edfd-483d-9e3e-fbd6e4b33e5a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:40.284270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851886-edfd-483d-9e3e-fbd6e4b33e5a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:40.284737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851886-edfd-483d-9e3e-fbd6e4b33e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:40.324545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-76851886-edfd-483d-9e3e-fbd6e4b33e5a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:40.329900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-76851886-edfd-483d-9e3e-fbd6e4b33e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:40.588030 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 873/1746] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:40.625252 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2931d-cb5b-43f5-9bdd-b184885ff361 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:40.715298 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76851886-edfd-483d-9e3e-fbd6e4b33e5a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:40.716726 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-76851886-edfd-483d-9e3e-fbd6e4b33e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:40.915381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2931d-cb5b-43f5-9bdd-b184885ff361 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:40.927311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1748a-ad32-4c49-9b12-af99101315c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:40.928124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1748a-ad32-4c49-9b12-af99101315c6 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:40.928288 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1748a-ad32-4c49-9b12-af99101315c6 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:40.928670 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1748a-ad32-4c49-9b12-af99101315c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:40.947993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76851886-edfd-483d-9e3e-fbd6e4b33e5a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:40.964940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883fdf7-0e51-4aa8-8756-ecffe310d7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:40.969135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883fdf7-0e51-4aa8-8756-ecffe310d7aa service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:40.969522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883fdf7-0e51-4aa8-8756-ecffe310d7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:40.970660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883fdf7-0e51-4aa8-8756-ecffe310d7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:41.007361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883fdf7-0e51-4aa8-8756-ecffe310d7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:41.012504 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883fdf7-0e51-4aa8-8756-ecffe310d7aa service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:41.053377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 874/1747] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:50:41.109979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1748a-ad32-4c49-9b12-af99101315c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:41.113123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1748a-ad32-4c49-9b12-af99101315c6 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:41.137699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 874/1748] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:42.384841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883fdf7-0e51-4aa8-8756-ecffe310d7aa service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:42.388318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7883fdf7-0e51-4aa8-8756-ecffe310d7aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:42.443642 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883fdf7-0e51-4aa8-8756-ecffe310d7aa service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:42.455756 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1748a-ad32-4c49-9b12-af99101315c6 service nova] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:42.457146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-14e1748a-ad32-4c49-9b12-af99101315c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:42.460601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:42.461602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:42.461886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:42.462946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] PATH_INFO: `/v3/projects/d617e0934788431085bebde1cec5dc02` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:42.466608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d617e0934788431085bebde1cec5dc02)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:42.472433 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:42.486711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1748a-ad32-4c49-9b12-af99101315c6 service nova] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:42.501256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:42.502721 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:42.503710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:42.504338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] PATH_INFO: `/v3/projects/53b0af9d76f1451e9c62fa41e93460c9` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:42.507652 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b0af9d76f1451e9c62fa41e93460c9)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:42.510669 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:42.559107 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd617e0934788431085bebde1cec5dc02', 'request_id': 'req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:42.567546 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd617e0934788431085bebde1cec5dc02', 'request_id': 'req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:42.578618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd617e0934788431085bebde1cec5dc02', 'request_id': 'req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:42.620342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] The token cache is being invalidate because project d617e0934788431085bebde1cec5dc02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:42.620342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:42.621796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:42.627459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 875/1749] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:42 2022] DELETE /identity/v3/projects/d617e0934788431085bebde1cec5dc02 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:42.629098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:42.634892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:42.655232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b0af9d76f1451e9c62fa41e93460c9', 'request_id': 'req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:42.670783 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b0af9d76f1451e9c62fa41e93460c9', 'request_id': 'req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:42.681440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b0af9d76f1451e9c62fa41e93460c9', 'request_id': 'req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:42.708145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] The token cache is being invalidate because project 53b0af9d76f1451e9c62fa41e93460c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:42.709506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:42.715269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:42.717519 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 875/1750] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:42 2022] DELETE /identity/v3/projects/53b0af9d76f1451e9c62fa41e93460c9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:42.721272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:42.722944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:42.860248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ea202-8155-4c0b-bbb8-e3967e9b8da7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:42.910991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e4996-f9b2-479b-81f4-78a86a3e15f0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:42.929056 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f718d-0e55-4e05-bed3-0848064f0c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:42.930000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f718d-0e55-4e05-bed3-0848064f0c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:42.930291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f718d-0e55-4e05-bed3-0848064f0c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:42.930566 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f718d-0e55-4e05-bed3-0848064f0c6a admin admin] PATH_INFO: `/v3/users/cf1f04c12a71451280a553b97ed1354e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:42.934021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f718d-0e55-4e05-bed3-0848064f0c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1f04c12a71451280a553b97ed1354e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:42.936100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f718d-0e55-4e05-bed3-0848064f0c6a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:43.045325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-823f718d-0e55-4e05-bed3-0848064f0c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1f04c12a71451280a553b97ed1354e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:43.058708 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-823f718d-0e55-4e05-bed3-0848064f0c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1f04c12a71451280a553b97ed1354e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:43.067318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:43.068482 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:43.068936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:43.069386 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] PATH_INFO: `/v3/users/08e28d21c52d404ca714fa77c0a1a41e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:43.071898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-823f718d-0e55-4e05-bed3-0848064f0c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1f04c12a71451280a553b97ed1354e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:43.072920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e28d21c52d404ca714fa77c0a1a41e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:43.075035 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:43.142528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-823f718d-0e55-4e05-bed3-0848064f0c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1f04c12a71451280a553b97ed1354e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:43.144663 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-823f718d-0e55-4e05-bed3-0848064f0c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1f04c12a71451280a553b97ed1354e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:43.170271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 876/1751] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:42 2022] DELETE /identity/v3/users/cf1f04c12a71451280a553b97ed1354e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:43.173847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e292c7-75b0-412e-9753-bb1728dd2b67 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:43.174368 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e292c7-75b0-412e-9753-bb1728dd2b67 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:43.174816 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e292c7-75b0-412e-9753-bb1728dd2b67 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:43.180376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 877/1752] 10.222.0.117 () {54 vars in 926 bytes} [Mon Jan 24 16:50:43 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:50:43.236098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e28d21c52d404ca714fa77c0a1a41e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:43.251677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254ded0-7bda-4962-ac9d-9fb3ecb7621e None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:43.252196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254ded0-7bda-4962-ac9d-9fb3ecb7621e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:43.252637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254ded0-7bda-4962-ac9d-9fb3ecb7621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:43.282722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e28d21c52d404ca714fa77c0a1a41e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:43.283677 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e28d21c52d404ca714fa77c0a1a41e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:43.286091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e28d21c52d404ca714fa77c0a1a41e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:43.300169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e28d21c52d404ca714fa77c0a1a41e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:43.302672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-3254ded0-7bda-4962-ac9d-9fb3ecb7621e None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:43.307957 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3254ded0-7bda-4962-ac9d-9fb3ecb7621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:43.328748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 876/1753] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:42 2022] DELETE /identity/v3/users/08e28d21c52d404ca714fa77c0a1a41e => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:43.563818 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 878/1754] 10.222.0.117 () {58 vars in 1023 bytes} [Mon Jan 24 16:50:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:45.053841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:45.056143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:45.204493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785340-32bb-4583-a4ba-3fb83df462b5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:45.209798 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:45.212784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:45.213306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:45.213790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] PATH_INFO: `/v3/projects/27a939817c12402ab99caf97f7403872` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:45.215498 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a939817c12402ab99caf97f7403872)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:45.217824 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:45.332576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a939817c12402ab99caf97f7403872', 'request_id': 'req-f4378bdc-5739-4716-9b8e-397b36c0d6e1'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:45.343457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a939817c12402ab99caf97f7403872', 'request_id': 'req-f4378bdc-5739-4716-9b8e-397b36c0d6e1'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:45.364374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a939817c12402ab99caf97f7403872', 'request_id': 'req-f4378bdc-5739-4716-9b8e-397b36c0d6e1'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:45.389622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] The token cache is being invalidate because project 27a939817c12402ab99caf97f7403872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:45.395625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254ded0-7bda-4962-ac9d-9fb3ecb7621e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:45.397342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3254ded0-7bda-4962-ac9d-9fb3ecb7621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:45.405640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:45.408511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f4378bdc-5739-4716-9b8e-397b36c0d6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:45.411323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 877/1755] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:45 2022] DELETE /identity/v3/projects/27a939817c12402ab99caf97f7403872 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:45.417133 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67fab-f7f0-49ce-a951-e28942c4f8d7 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:45.417413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67fab-f7f0-49ce-a951-e28942c4f8d7 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:45.418734 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67fab-f7f0-49ce-a951-e28942c4f8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:45.427106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254ded0-7bda-4962-ac9d-9fb3ecb7621e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:45.456023 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-e5e67fab-f7f0-49ce-a951-e28942c4f8d7 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:45.457923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e5e67fab-f7f0-49ce-a951-e28942c4f8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:45.568363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 878/1756] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:45.576969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfff2f-9fb1-4e69-908a-4f7eccc0ce17 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:45.577499 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfff2f-9fb1-4e69-908a-4f7eccc0ce17 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:45.577933 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfff2f-9fb1-4e69-908a-4f7eccc0ce17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:45.625034 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-1ccfff2f-9fb1-4e69-908a-4f7eccc0ce17 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:45.629682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1ccfff2f-9fb1-4e69-908a-4f7eccc0ce17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:45.646460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5a62-3f2d-4f5b-bc89-ed16e1e23c88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:45.648099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5a62-3f2d-4f5b-bc89-ed16e1e23c88 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:45.648385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5a62-3f2d-4f5b-bc89-ed16e1e23c88 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:45.651928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 879/1757] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:45.656625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfff2f-9fb1-4e69-908a-4f7eccc0ce17 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:45.659101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5a62-3f2d-4f5b-bc89-ed16e1e23c88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:45.667656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-cb0b5a62-3f2d-4f5b-bc89-ed16e1e23c88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:45.683852 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfff2f-9fb1-4e69-908a-4f7eccc0ce17 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:45.697617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05207f9-6789-4ddb-b6ba-7c66202a5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:45.698698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05207f9-6789-4ddb-b6ba-7c66202a5e98 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:45.699175 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05207f9-6789-4ddb-b6ba-7c66202a5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:45.699666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05207f9-6789-4ddb-b6ba-7c66202a5e98 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:45.700181 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b5a62-3f2d-4f5b-bc89-ed16e1e23c88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:45.700729 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05207f9-6789-4ddb-b6ba-7c66202a5e98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:45.701238 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05207f9-6789-4ddb-b6ba-7c66202a5e98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:45.704482 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05207f9-6789-4ddb-b6ba-7c66202a5e98 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:45.705631 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b5a62-3f2d-4f5b-bc89-ed16e1e23c88 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:45.738960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 880/1758] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:45.742466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05207f9-6789-4ddb-b6ba-7c66202a5e98 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:45.760352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 879/1759] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:45.766460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05207f9-6789-4ddb-b6ba-7c66202a5e98 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:45.779160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f7ddf-d547-4dc7-8d18-16aa1425566b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:45.779837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f7ddf-d547-4dc7-8d18-16aa1425566b admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:45.780124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f7ddf-d547-4dc7-8d18-16aa1425566b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:45.780402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f7ddf-d547-4dc7-8d18-16aa1425566b admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:45.781118 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f7ddf-d547-4dc7-8d18-16aa1425566b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:45.788254 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f7ddf-d547-4dc7-8d18-16aa1425566b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:45.867965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5a62-3f2d-4f5b-bc89-ed16e1e23c88 service nova] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:45.870996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-cb0b5a62-3f2d-4f5b-bc89-ed16e1e23c88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:45.893942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 881/1760] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:45 2022] POST /identity/v3/projects => generated 370 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:45.895362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f7ddf-d547-4dc7-8d18-16aa1425566b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:45.923404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5a62-3f2d-4f5b-bc89-ed16e1e23c88 service nova] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:46.082594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:46.083724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:46.085359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:46.086251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] PATH_INFO: `/v3/projects/a085225b930d472fa4d9f1bf5cef6177` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:46.092316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a085225b930d472fa4d9f1bf5cef6177)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:46.095315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:46.178401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f7ddf-d547-4dc7-8d18-16aa1425566b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:46.195963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be2bf1-3e52-4403-8ab7-e085bd0b36d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:46.197264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be2bf1-3e52-4403-8ab7-e085bd0b36d4 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:46.197952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be2bf1-3e52-4403-8ab7-e085bd0b36d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:46.198334 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be2bf1-3e52-4403-8ab7-e085bd0b36d4 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:46.208452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be2bf1-3e52-4403-8ab7-e085bd0b36d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:46.211301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be2bf1-3e52-4403-8ab7-e085bd0b36d4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:46.221813 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a085225b930d472fa4d9f1bf5cef6177', 'request_id': 'req-4459ce39-44d8-47d6-a3ef-6225e2cf2022'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:46.241001 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a085225b930d472fa4d9f1bf5cef6177', 'request_id': 'req-4459ce39-44d8-47d6-a3ef-6225e2cf2022'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:46.255248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 882/1761] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:45 2022] POST /identity/v3/users => generated 286 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:46.259426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a085225b930d472fa4d9f1bf5cef6177', 'request_id': 'req-4459ce39-44d8-47d6-a3ef-6225e2cf2022'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:46.260876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be2bf1-3e52-4403-8ab7-e085bd0b36d4 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:46.282648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be2bf1-3e52-4403-8ab7-e085bd0b36d4 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:46.295475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] The token cache is being invalidate because project a085225b930d472fa4d9f1bf5cef6177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:46.295875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:46.298434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:46.303010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 880/1762] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:45 2022] DELETE /identity/v3/projects/a085225b930d472fa4d9f1bf5cef6177 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:46.308583 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:46.310132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:46.443379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0dc0e-5ff9-4b2a-bec9-68c0fe0ce2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:46.444181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0dc0e-5ff9-4b2a-bec9-68c0fe0ce2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:46.444698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0dc0e-5ff9-4b2a-bec9-68c0fe0ce2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:46.445080 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0dc0e-5ff9-4b2a-bec9-68c0fe0ce2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:46.446825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0dc0e-5ff9-4b2a-bec9-68c0fe0ce2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:46.455550 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0dc0e-5ff9-4b2a-bec9-68c0fe0ce2f9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:46.483111 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 883/1763] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:46 2022] GET /identity/v3/roles => generated 1427 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:46.483244 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ce39-44d8-47d6-a3ef-6225e2cf2022 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:46.485044 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0dc0e-5ff9-4b2a-bec9-68c0fe0ce2f9 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:46.493126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8bf0dc0e-5ff9-4b2a-bec9-68c0fe0ce2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:46.503643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:46.504539 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:46.504820 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:46.505097 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] PATH_INFO: `/v3/users/c6bc299177fb46d28d5f03d7ce4617a2` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:46.508377 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bc299177fb46d28d5f03d7ce4617a2)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:46.519609 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:46.522584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0dc0e-5ff9-4b2a-bec9-68c0fe0ce2f9 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:46.539068 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a122d-cb6e-461f-acc1-30e66a49befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:46.540830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a122d-cb6e-461f-acc1-30e66a49befc admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:46.541510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a122d-cb6e-461f-acc1-30e66a49befc admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:46.542329 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a122d-cb6e-461f-acc1-30e66a49befc admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:46.543327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a122d-cb6e-461f-acc1-30e66a49befc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:46.547221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a122d-cb6e-461f-acc1-30e66a49befc admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:46.579891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 884/1764] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:46 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:46.598966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a122d-cb6e-461f-acc1-30e66a49befc admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:46.631621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a122d-cb6e-461f-acc1-30e66a49befc admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:46.636222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bc299177fb46d28d5f03d7ce4617a2'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:46.639970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43225eff-a839-491c-9ec8-f99f85a27adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:46.641156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43225eff-a839-491c-9ec8-f99f85a27adb admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:46.641767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43225eff-a839-491c-9ec8-f99f85a27adb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:46.642196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43225eff-a839-491c-9ec8-f99f85a27adb admin admin] PATH_INFO: `/v3/projects/e8ca94fb7a2044b2b1ee2d0b371feea3/users/b813cda285224495b88fbc622ff24310/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:46.654414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bc299177fb46d28d5f03d7ce4617a2'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:46.668305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bc299177fb46d28d5f03d7ce4617a2'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:46.689056 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43225eff-a839-491c-9ec8-f99f85a27adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ca94fb7a2044b2b1ee2d0b371feea3, user_id=b813cda285224495b88fbc622ff24310, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:46.700068 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43225eff-a839-491c-9ec8-f99f85a27adb admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:46.732089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 885/1765] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:46 2022] PUT /identity/v3/projects/e8ca94fb7a2044b2b1ee2d0b371feea3/users/b813cda285224495b88fbc622ff24310/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:46.733897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bdd59-6996-43d7-baec-cf351ac383b6 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:46.734672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bc299177fb46d28d5f03d7ce4617a2'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:46.735415 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bdd59-6996-43d7-baec-cf351ac383b6 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:46.736046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bc299177fb46d28d5f03d7ce4617a2'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:46.736607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bdd59-6996-43d7-baec-cf351ac383b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:46.750365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 881/1766] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:46 2022] DELETE /identity/v3/users/c6bc299177fb46d28d5f03d7ce4617a2 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:46.798499 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-573bdd59-6996-43d7-baec-cf351ac383b6 None None] MFA Rules not processed for user `b813cda285224495b88fbc622ff24310`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:46.799964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-573bdd59-6996-43d7-baec-cf351ac383b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:47.000532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 886/1767] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:47.001935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:47.003736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:47.147180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85ef1-6ae2-41e3-97cd-a95998c6536f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:47.159516 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cc8c9-fe04-4f01-97f4-aa3ff1d2ada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:47.160197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cc8c9-fe04-4f01-97f4-aa3ff1d2ada0 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:47.160476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cc8c9-fe04-4f01-97f4-aa3ff1d2ada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:47.160753 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cc8c9-fe04-4f01-97f4-aa3ff1d2ada0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:47.161468 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cc8c9-fe04-4f01-97f4-aa3ff1d2ada0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:47.163443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cc8c9-fe04-4f01-97f4-aa3ff1d2ada0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:47.196939 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 882/1768] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:47 2022] POST /identity/v3/projects => generated 366 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:47.201577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bdd59-6996-43d7-baec-cf351ac383b6 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:47.219467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bdd59-6996-43d7-baec-cf351ac383b6 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:47.314464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03002d-0be6-41e3-97b7-55c1accb8d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:47.317131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03002d-0be6-41e3-97b7-55c1accb8d5a admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:47.317596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03002d-0be6-41e3-97b7-55c1accb8d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:47.320642 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03002d-0be6-41e3-97b7-55c1accb8d5a admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:47.322893 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03002d-0be6-41e3-97b7-55c1accb8d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:47.327387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03002d-0be6-41e3-97b7-55c1accb8d5a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:47.364810 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 887/1769] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:47 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:50:47.370040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cc8c9-fe04-4f01-97f4-aa3ff1d2ada0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:47.388141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cc8c9-fe04-4f01-97f4-aa3ff1d2ada0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:47.400741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc37ad9-031b-4d2e-ac34-57c52a85bfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:47.401865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc37ad9-031b-4d2e-ac34-57c52a85bfad admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:47.402255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc37ad9-031b-4d2e-ac34-57c52a85bfad admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:47.402662 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc37ad9-031b-4d2e-ac34-57c52a85bfad admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:47.403565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc37ad9-031b-4d2e-ac34-57c52a85bfad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:47.405373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc37ad9-031b-4d2e-ac34-57c52a85bfad admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:47.425402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 883/1770] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:47 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:47.429632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03002d-0be6-41e3-97b7-55c1accb8d5a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:47.448102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03002d-0be6-41e3-97b7-55c1accb8d5a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:47.463136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67de41-adbe-47c6-bf47-eccd06b9b220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:47.466691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67de41-adbe-47c6-bf47-eccd06b9b220 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:47.467338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67de41-adbe-47c6-bf47-eccd06b9b220 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:47.469271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67de41-adbe-47c6-bf47-eccd06b9b220 admin admin] PATH_INFO: `/v3/projects/c492aaca06194ef1a6560e8c2ca0423b/users/2abca90add764283a2535babd896cc8d/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:47.510614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67de41-adbe-47c6-bf47-eccd06b9b220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c492aaca06194ef1a6560e8c2ca0423b, user_id=2abca90add764283a2535babd896cc8d, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:47.517287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29cc00-6577-422c-8a29-5992cf832050 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:47.517751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29cc00-6577-422c-8a29-5992cf832050 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:47.517842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29cc00-6577-422c-8a29-5992cf832050 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:47.520097 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 884/1771] 10.222.0.117 () {54 vars in 926 bytes} [Mon Jan 24 16:50:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:50:47.524920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67de41-adbe-47c6-bf47-eccd06b9b220 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:47.548655 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 888/1772] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:47 2022] PUT /identity/v3/projects/c492aaca06194ef1a6560e8c2ca0423b/users/2abca90add764283a2535babd896cc8d/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:47.552705 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29cc00-6577-422c-8a29-5992cf832050 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:47.587993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf88fa-d5a4-49e4-8d39-d3a308bd0c54 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:47.588807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf88fa-d5a4-49e4-8d39-d3a308bd0c54 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:47.588958 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf88fa-d5a4-49e4-8d39-d3a308bd0c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:47.655579 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-2aaf88fa-d5a4-49e4-8d39-d3a308bd0c54 None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:47.667594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2aaf88fa-d5a4-49e4-8d39-d3a308bd0c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:47.785039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29cc00-6577-422c-8a29-5992cf832050 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:47.803467 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c2842-2e03-4e5b-b791-9ffc090f2e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:47.804867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c2842-2e03-4e5b-b791-9ffc090f2e3d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:47.805160 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c2842-2e03-4e5b-b791-9ffc090f2e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:47.805511 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c2842-2e03-4e5b-b791-9ffc090f2e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:47.808177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 889/1773] 10.222.0.117 () {58 vars in 1023 bytes} [Mon Jan 24 16:50:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:47.809546 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8f3d8-1416-46d3-9efe-84fe0cd5eabf None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:47.809926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8f3d8-1416-46d3-9efe-84fe0cd5eabf None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:47.810094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8f3d8-1416-46d3-9efe-84fe0cd5eabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:47.810465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c2842-2e03-4e5b-b791-9ffc090f2e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:47.812207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c2842-2e03-4e5b-b791-9ffc090f2e3d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:47.839251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 885/1774] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:47 2022] GET /identity/v3/roles => generated 1427 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:50:47.840255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c2842-2e03-4e5b-b791-9ffc090f2e3d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:47.852472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-21a8f3d8-1416-46d3-9efe-84fe0cd5eabf None None] MFA Rules not processed for user `f86b459cc02f4f38a2ced5f25972535f`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:47.853696 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-21a8f3d8-1416-46d3-9efe-84fe0cd5eabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:47.859214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c2842-2e03-4e5b-b791-9ffc090f2e3d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:47.877913 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2cb8d-6799-4e60-a65a-ce9ebedd1316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:47.878835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2cb8d-6799-4e60-a65a-ce9ebedd1316 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:47.879125 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2cb8d-6799-4e60-a65a-ce9ebedd1316 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:47.880281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2cb8d-6799-4e60-a65a-ce9ebedd1316 admin admin] PATH_INFO: `/v3/projects/c492aaca06194ef1a6560e8c2ca0423b/users/2abca90add764283a2535babd896cc8d/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:47.885695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2cb8d-6799-4e60-a65a-ce9ebedd1316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c492aaca06194ef1a6560e8c2ca0423b, user_id=2abca90add764283a2535babd896cc8d, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:47.888815 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2cb8d-6799-4e60-a65a-ce9ebedd1316 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:47.920258 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 886/1775] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:47 2022] PUT /identity/v3/projects/c492aaca06194ef1a6560e8c2ca0423b/users/2abca90add764283a2535babd896cc8d/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:47.938154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296bd43-e7ff-46b8-a874-9714db67a28e None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:47.938589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296bd43-e7ff-46b8-a874-9714db67a28e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:47.939427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296bd43-e7ff-46b8-a874-9714db67a28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:47.980460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 890/1776] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:47.991509 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d296bd43-e7ff-46b8-a874-9714db67a28e None None] MFA Rules not processed for user `2abca90add764283a2535babd896cc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:47.992914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d296bd43-e7ff-46b8-a874-9714db67a28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:48.100382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 887/1777] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:48.112931 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8f3d8-1416-46d3-9efe-84fe0cd5eabf None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:48.114564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-21a8f3d8-1416-46d3-9efe-84fe0cd5eabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:48.277069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8f3d8-1416-46d3-9efe-84fe0cd5eabf None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:48.359222 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9897e-7f79-4121-ab8f-c7c70f552f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:48.360645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9897e-7f79-4121-ab8f-c7c70f552f5a service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:48.360932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9897e-7f79-4121-ab8f-c7c70f552f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:48.361207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9897e-7f79-4121-ab8f-c7c70f552f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:48.374383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9897e-7f79-4121-ab8f-c7c70f552f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:48.377228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9897e-7f79-4121-ab8f-c7c70f552f5a service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:48.392441 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 891/1778] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:48.408589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296bd43-e7ff-46b8-a874-9714db67a28e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:48.410110 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d296bd43-e7ff-46b8-a874-9714db67a28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:48.602608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296bd43-e7ff-46b8-a874-9714db67a28e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:48.610588 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2592ba-64fe-419f-a8a3-41d94f019426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:48.611282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2592ba-64fe-419f-a8a3-41d94f019426 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:48.611564 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2592ba-64fe-419f-a8a3-41d94f019426 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:48.612428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2592ba-64fe-419f-a8a3-41d94f019426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:48.645506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2592ba-64fe-419f-a8a3-41d94f019426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:48.647218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2592ba-64fe-419f-a8a3-41d94f019426 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:48.684467 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 888/1779] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:48.944559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9897e-7f79-4121-ab8f-c7c70f552f5a service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:48.946815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-61d9897e-7f79-4121-ab8f-c7c70f552f5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:49.070679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9897e-7f79-4121-ab8f-c7c70f552f5a service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:49.076695 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:49.077670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:49.078212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:49.078705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] PATH_INFO: `/v3/projects/2865df3245944d5c9428758390d4201b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:49.080682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2865df3245944d5c9428758390d4201b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:49.083049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:49.109189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34bb60-6b84-487c-b217-64fcebef0cd3 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:49.109535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34bb60-6b84-487c-b217-64fcebef0cd3 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:49.109822 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34bb60-6b84-487c-b217-64fcebef0cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:49.168049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-3a34bb60-6b84-487c-b217-64fcebef0cd3 None None] MFA Rules not processed for user `b359098928524e869cf3ffe527902ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:49.169177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3a34bb60-6b84-487c-b217-64fcebef0cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:49.175265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2865df3245944d5c9428758390d4201b', 'request_id': 'req-6dc43924-e598-4af2-ab2d-42c2ccbabd97'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:49.189170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2865df3245944d5c9428758390d4201b', 'request_id': 'req-6dc43924-e598-4af2-ab2d-42c2ccbabd97'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:49.216092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2865df3245944d5c9428758390d4201b', 'request_id': 'req-6dc43924-e598-4af2-ab2d-42c2ccbabd97'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:49.235509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] The token cache is being invalidate because project 2865df3245944d5c9428758390d4201b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:49.235857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:49.236807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6dc43924-e598-4af2-ab2d-42c2ccbabd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:49.238912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 892/1780] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:48 2022] DELETE /identity/v3/projects/2865df3245944d5c9428758390d4201b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:49.249243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428481f1-8a4a-4ba6-9439-8b3586c4f498 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:49.250260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428481f1-8a4a-4ba6-9439-8b3586c4f498 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:49.250802 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428481f1-8a4a-4ba6-9439-8b3586c4f498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:49.266114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 889/1781] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:49 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:49.280091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34bb60-6b84-487c-b217-64fcebef0cd3 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:49.281732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-428481f1-8a4a-4ba6-9439-8b3586c4f498 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:49.283610 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-428481f1-8a4a-4ba6-9439-8b3586c4f498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:49.284376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3a34bb60-6b84-487c-b217-64fcebef0cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:49.369253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 893/1782] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:49.372399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70520a-aa79-428b-8f51-e3bb2f91efe1 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:49.372901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70520a-aa79-428b-8f51-e3bb2f91efe1 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:49.373371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70520a-aa79-428b-8f51-e3bb2f91efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:49.463753 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5a70520a-aa79-428b-8f51-e3bb2f91efe1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:49.465635 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34bb60-6b84-487c-b217-64fcebef0cd3 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:49.466195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5a70520a-aa79-428b-8f51-e3bb2f91efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:49.478317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 894/1783] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:49.482482 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffef32-54dc-46f7-b932-399b3edcd9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:49.483087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70520a-aa79-428b-8f51-e3bb2f91efe1 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:49.483577 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffef32-54dc-46f7-b932-399b3edcd9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:49.484005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffef32-54dc-46f7-b932-399b3edcd9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:49.484427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffef32-54dc-46f7-b932-399b3edcd9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:49.485469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffef32-54dc-46f7-b932-399b3edcd9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:49.487603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffef32-54dc-46f7-b932-399b3edcd9d2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:49.504876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70520a-aa79-428b-8f51-e3bb2f91efe1 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:49.512762 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004bf90-f110-4966-91f0-ac17a672357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:49.513761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004bf90-f110-4966-91f0-ac17a672357c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:49.514173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004bf90-f110-4966-91f0-ac17a672357c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:49.514571 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004bf90-f110-4966-91f0-ac17a672357c admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:49.515460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004bf90-f110-4966-91f0-ac17a672357c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:49.515873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004bf90-f110-4966-91f0-ac17a672357c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:49.517919 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004bf90-f110-4966-91f0-ac17a672357c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:49.553267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 890/1784] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:49 2022] POST /identity/v3/projects => generated 406 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:49.554172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 895/1785] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:50:49.559794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffef32-54dc-46f7-b932-399b3edcd9d2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:49.561526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004bf90-f110-4966-91f0-ac17a672357c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:49.562214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-56ffef32-54dc-46f7-b932-399b3edcd9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:49.596560 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004bf90-f110-4966-91f0-ac17a672357c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:49.716798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffef32-54dc-46f7-b932-399b3edcd9d2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:49.723088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861807f-4142-4214-80b1-c9dce8ff4085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:49.723939 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861807f-4142-4214-80b1-c9dce8ff4085 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:49.724319 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861807f-4142-4214-80b1-c9dce8ff4085 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:49.724990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861807f-4142-4214-80b1-c9dce8ff4085 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:49.725900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861807f-4142-4214-80b1-c9dce8ff4085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:49.730175 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861807f-4142-4214-80b1-c9dce8ff4085 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:49.760379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ee34-8f48-4846-9978-5c8fcadf5c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:49.761607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ee34-8f48-4846-9978-5c8fcadf5c2d admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:49.762282 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ee34-8f48-4846-9978-5c8fcadf5c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:49.765367 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 891/1786] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:49 2022] POST /identity/v3/users => generated 310 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:50:49.765492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ee34-8f48-4846-9978-5c8fcadf5c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:49.765492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306ee34-8f48-4846-9978-5c8fcadf5c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:49.766795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306ee34-8f48-4846-9978-5c8fcadf5c2d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:49.767476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861807f-4142-4214-80b1-c9dce8ff4085 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:49.784280 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861807f-4142-4214-80b1-c9dce8ff4085 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:49.794167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a4ec-a371-42c4-9345-93a015477c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:49.795131 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a4ec-a371-42c4-9345-93a015477c14 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:49.796392 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a4ec-a371-42c4-9345-93a015477c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:49.796673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a4ec-a371-42c4-9345-93a015477c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:49.797573 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9a4ec-a371-42c4-9345-93a015477c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:49.799684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9a4ec-a371-42c4-9345-93a015477c14 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:49.814605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 892/1787] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:49 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:49.817985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a4ec-a371-42c4-9345-93a015477c14 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:49.833468 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a4ec-a371-42c4-9345-93a015477c14 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:49.847722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec148c29-7a90-4efd-9e1c-3b5c8de3752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:49.848769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec148c29-7a90-4efd-9e1c-3b5c8de3752c admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:49.849789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec148c29-7a90-4efd-9e1c-3b5c8de3752c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:49.850080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec148c29-7a90-4efd-9e1c-3b5c8de3752c admin admin] PATH_INFO: `/v3/projects/d790c2c4a1084711a335817276ffcdd7/users/e266e6dae69841f5b447166a8f77037e/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:49.866792 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 896/1788] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:49 2022] POST /identity/v3/projects => generated 362 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:49.868223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ee34-8f48-4846-9978-5c8fcadf5c2d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:49.877087 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec148c29-7a90-4efd-9e1c-3b5c8de3752c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d790c2c4a1084711a335817276ffcdd7, user_id=e266e6dae69841f5b447166a8f77037e, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:49.907882 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec148c29-7a90-4efd-9e1c-3b5c8de3752c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:49.958916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 893/1789] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:49 2022] PUT /identity/v3/projects/d790c2c4a1084711a335817276ffcdd7/users/e266e6dae69841f5b447166a8f77037e/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:49.963602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec148c29-7a90-4efd-9e1c-3b5c8de3752c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:50.043972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ee34-8f48-4846-9978-5c8fcadf5c2d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:50.141128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec148c29-7a90-4efd-9e1c-3b5c8de3752c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:50.151162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffd463-cd45-45a4-8e9f-6fb4de997b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:50.151846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffd463-cd45-45a4-8e9f-6fb4de997b37 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:50.152524 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffd463-cd45-45a4-8e9f-6fb4de997b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:50.152806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffd463-cd45-45a4-8e9f-6fb4de997b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:50.153709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffd463-cd45-45a4-8e9f-6fb4de997b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:50.158881 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffd463-cd45-45a4-8e9f-6fb4de997b37 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:50.175335 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 894/1790] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:49 2022] GET /identity/v3/roles => generated 1427 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:50.175961 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63956869-5eb5-4520-b05c-250584f7e7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:50.176645 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63956869-5eb5-4520-b05c-250584f7e7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:50.176923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63956869-5eb5-4520-b05c-250584f7e7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:50.177193 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63956869-5eb5-4520-b05c-250584f7e7b3 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:50.177890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63956869-5eb5-4520-b05c-250584f7e7b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:50.179393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffd463-cd45-45a4-8e9f-6fb4de997b37 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:50.180957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63956869-5eb5-4520-b05c-250584f7e7b3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:50.194706 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffd463-cd45-45a4-8e9f-6fb4de997b37 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:50.201229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349987aa-e2c3-479f-9128-79c4650fc81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:50.203108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349987aa-e2c3-479f-9128-79c4650fc81c admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:50.203591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349987aa-e2c3-479f-9128-79c4650fc81c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:50.204063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349987aa-e2c3-479f-9128-79c4650fc81c admin admin] PATH_INFO: `/v3/projects/d790c2c4a1084711a335817276ffcdd7/users/e266e6dae69841f5b447166a8f77037e/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:50.208615 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349987aa-e2c3-479f-9128-79c4650fc81c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d790c2c4a1084711a335817276ffcdd7, user_id=e266e6dae69841f5b447166a8f77037e, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:50.214795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349987aa-e2c3-479f-9128-79c4650fc81c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:50.230425 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 895/1791] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:50 2022] PUT /identity/v3/projects/d790c2c4a1084711a335817276ffcdd7/users/e266e6dae69841f5b447166a8f77037e/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:50.250288 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 897/1792] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:49 2022] POST /identity/v3/users => generated 282 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:50.250735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349987aa-e2c3-479f-9128-79c4650fc81c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:50.333152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349987aa-e2c3-479f-9128-79c4650fc81c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:50.341085 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f70273-405a-4165-af6b-866c42a79a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:50.342119 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f70273-405a-4165-af6b-866c42a79a84 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:50.342776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f70273-405a-4165-af6b-866c42a79a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:50.343461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f70273-405a-4165-af6b-866c42a79a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:50.344673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f70273-405a-4165-af6b-866c42a79a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:50.347432 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f70273-405a-4165-af6b-866c42a79a84 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:50.365277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 896/1793] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:50 2022] GET /identity/v3/roles => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:50.369590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63956869-5eb5-4520-b05c-250584f7e7b3 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:50.382657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63956869-5eb5-4520-b05c-250584f7e7b3 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:50.389411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed260ef-8af5-468c-bd1f-c0a31cd6444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:50.403215 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed260ef-8af5-468c-bd1f-c0a31cd6444c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:50.404908 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed260ef-8af5-468c-bd1f-c0a31cd6444c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:50.405202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed260ef-8af5-468c-bd1f-c0a31cd6444c admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:50.409275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed260ef-8af5-468c-bd1f-c0a31cd6444c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:50.411413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed260ef-8af5-468c-bd1f-c0a31cd6444c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:50.450054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 898/1794] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:50 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:50.454819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f70273-405a-4165-af6b-866c42a79a84 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:50.470907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f70273-405a-4165-af6b-866c42a79a84 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:50.479017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2724ed9-bb95-4ad3-9d20-c01b8f52aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:50.480349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2724ed9-bb95-4ad3-9d20-c01b8f52aa70 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:50.480767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2724ed9-bb95-4ad3-9d20-c01b8f52aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:50.481151 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2724ed9-bb95-4ad3-9d20-c01b8f52aa70 admin admin] PATH_INFO: `/v3/projects/0b2e09036d6543d9b2264e62fd0cf554/users/93033f299c4d4ae992e89d516f6d9c0d/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:50.504723 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2724ed9-bb95-4ad3-9d20-c01b8f52aa70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2e09036d6543d9b2264e62fd0cf554, user_id=93033f299c4d4ae992e89d516f6d9c0d, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:50.509123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2724ed9-bb95-4ad3-9d20-c01b8f52aa70 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:50.536173 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 897/1795] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:50 2022] PUT /identity/v3/projects/0b2e09036d6543d9b2264e62fd0cf554/users/93033f299c4d4ae992e89d516f6d9c0d/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:50.548556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743a22b-446c-45b6-9e57-e4d5a62a5b7b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:50.549280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743a22b-446c-45b6-9e57-e4d5a62a5b7b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:50.549883 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743a22b-446c-45b6-9e57-e4d5a62a5b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:50.598552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-6743a22b-446c-45b6-9e57-e4d5a62a5b7b None None] MFA Rules not processed for user `93033f299c4d4ae992e89d516f6d9c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:50.601597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6743a22b-446c-45b6-9e57-e4d5a62a5b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:50.669516 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2724ed9-bb95-4ad3-9d20-c01b8f52aa70 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:50.674058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a2724ed9-bb95-4ad3-9d20-c01b8f52aa70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:50.739073 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 899/1796] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:50.772150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743a22b-446c-45b6-9e57-e4d5a62a5b7b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:50.773763 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6743a22b-446c-45b6-9e57-e4d5a62a5b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:50.780226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2724ed9-bb95-4ad3-9d20-c01b8f52aa70 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:50.788279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f805f-eb94-4f98-87c0-8450d812003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:50.789281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f805f-eb94-4f98-87c0-8450d812003b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:50.790455 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f805f-eb94-4f98-87c0-8450d812003b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:50.790742 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f805f-eb94-4f98-87c0-8450d812003b admin admin] PATH_INFO: `/v3/users/b813cda285224495b88fbc622ff24310` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:50.792269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f805f-eb94-4f98-87c0-8450d812003b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b813cda285224495b88fbc622ff24310)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:50.794521 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f805f-eb94-4f98-87c0-8450d812003b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:50.854823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743a22b-446c-45b6-9e57-e4d5a62a5b7b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:50.858590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc034109-69f6-452e-b871-7102244fbf08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:50.859537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc034109-69f6-452e-b871-7102244fbf08 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:50.859537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc034109-69f6-452e-b871-7102244fbf08 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:50.859801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc034109-69f6-452e-b871-7102244fbf08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:50.862231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-fc7f805f-eb94-4f98-87c0-8450d812003b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b813cda285224495b88fbc622ff24310'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:50.870183 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc034109-69f6-452e-b871-7102244fbf08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:50.871827 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc034109-69f6-452e-b871-7102244fbf08 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:50.881656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-fc7f805f-eb94-4f98-87c0-8450d812003b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b813cda285224495b88fbc622ff24310'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:50.902348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 900/1797] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:50.902608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-fc7f805f-eb94-4f98-87c0-8450d812003b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b813cda285224495b88fbc622ff24310'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:50.903536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc034109-69f6-452e-b871-7102244fbf08 service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:50.921933 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc034109-69f6-452e-b871-7102244fbf08 service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:50.929014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51a900-4fd7-4f6a-8c33-2c1bc73ede66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:50.929991 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a900-4fd7-4f6a-8c33-2c1bc73ede66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:50.931082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a900-4fd7-4f6a-8c33-2c1bc73ede66 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:50.931372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a900-4fd7-4f6a-8c33-2c1bc73ede66 admin admin] PATH_INFO: `/v3/users/93033f299c4d4ae992e89d516f6d9c0d` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:50.933245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-fc7f805f-eb94-4f98-87c0-8450d812003b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b813cda285224495b88fbc622ff24310'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:50.933932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51a900-4fd7-4f6a-8c33-2c1bc73ede66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93033f299c4d4ae992e89d516f6d9c0d)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:50.934058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-fc7f805f-eb94-4f98-87c0-8450d812003b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b813cda285224495b88fbc622ff24310'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:50.937186 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51a900-4fd7-4f6a-8c33-2c1bc73ede66 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:50.945956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 898/1798] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:50 2022] DELETE /identity/v3/users/b813cda285224495b88fbc622ff24310 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:50:50.947566 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5215-ed77-4667-a1cb-aeaa5dd483cc None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:50.947857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5215-ed77-4667-a1cb-aeaa5dd483cc None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:50.948135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5215-ed77-4667-a1cb-aeaa5dd483cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:50.976460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-88aa5215-ed77-4667-a1cb-aeaa5dd483cc None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:50.978931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-88aa5215-ed77-4667-a1cb-aeaa5dd483cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:51.010033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fc51a900-4fd7-4f6a-8c33-2c1bc73ede66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93033f299c4d4ae992e89d516f6d9c0d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:51.031449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fc51a900-4fd7-4f6a-8c33-2c1bc73ede66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93033f299c4d4ae992e89d516f6d9c0d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:51.032279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fc51a900-4fd7-4f6a-8c33-2c1bc73ede66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93033f299c4d4ae992e89d516f6d9c0d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:51.032970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fc51a900-4fd7-4f6a-8c33-2c1bc73ede66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93033f299c4d4ae992e89d516f6d9c0d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:51.050784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fc51a900-4fd7-4f6a-8c33-2c1bc73ede66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93033f299c4d4ae992e89d516f6d9c0d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:51.068974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 901/1799] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:50 2022] DELETE /identity/v3/users/93033f299c4d4ae992e89d516f6d9c0d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:51.075819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 899/1800] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:51.076280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fbd5c-287c-4cfd-9f41-087289d56c31 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:51.076280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fbd5c-287c-4cfd-9f41-087289d56c31 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:51.076280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fbd5c-287c-4cfd-9f41-087289d56c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:51.096489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ee5fbd5c-287c-4cfd-9f41-087289d56c31 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:51.097851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ee5fbd5c-287c-4cfd-9f41-087289d56c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:51.097970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5215-ed77-4667-a1cb-aeaa5dd483cc None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:51.099385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-88aa5215-ed77-4667-a1cb-aeaa5dd483cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:51.191096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5215-ed77-4667-a1cb-aeaa5dd483cc None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:51.203280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 902/1801] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:51.226691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fbd5c-287c-4cfd-9f41-087289d56c31 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:51.271019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617f413-68cf-4026-be54-98dc368886f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:51.271914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f413-68cf-4026-be54-98dc368886f3 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:51.272396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f413-68cf-4026-be54-98dc368886f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:51.272851 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f413-68cf-4026-be54-98dc368886f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:51.289036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617f413-68cf-4026-be54-98dc368886f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:51.294449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617f413-68cf-4026-be54-98dc368886f3 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:51.308059 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fbd5c-287c-4cfd-9f41-087289d56c31 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:51.313560 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28bc67-1b15-4a4c-814e-d5331d4af13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:51.314604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28bc67-1b15-4a4c-814e-d5331d4af13f service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:51.315087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28bc67-1b15-4a4c-814e-d5331d4af13f service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:51.315504 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28bc67-1b15-4a4c-814e-d5331d4af13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:51.329370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 900/1802] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:50:51.331013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28bc67-1b15-4a4c-814e-d5331d4af13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:51.334012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28bc67-1b15-4a4c-814e-d5331d4af13f service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:51.347871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 903/1803] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:50:51.443686 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea948db1-c647-412b-b09a-96f544a31205 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:51.444366 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea948db1-c647-412b-b09a-96f544a31205 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:51.444870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea948db1-c647-412b-b09a-96f544a31205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:51.518683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ea948db1-c647-412b-b09a-96f544a31205 None None] MFA Rules not processed for user `e266e6dae69841f5b447166a8f77037e`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:51.520399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ea948db1-c647-412b-b09a-96f544a31205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:51.665696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 901/1804] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:52.557444 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca459e-7885-4f77-8a65-e4f2d54f3481 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:52.558338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca459e-7885-4f77-8a65-e4f2d54f3481 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:52.558832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca459e-7885-4f77-8a65-e4f2d54f3481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:52.579843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-36ca459e-7885-4f77-8a65-e4f2d54f3481 None None] MFA Rules not processed for user `edb10d68444a4c6e947c1e356987736f`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:52.582244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-36ca459e-7885-4f77-8a65-e4f2d54f3481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:52.650639 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea948db1-c647-412b-b09a-96f544a31205 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:52.653353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ea948db1-c647-412b-b09a-96f544a31205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:52.689041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea948db1-c647-412b-b09a-96f544a31205 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:52.708357 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:52.709237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:52.709519 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:52.709790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] PATH_INFO: `/v3/projects/e8ca94fb7a2044b2b1ee2d0b371feea3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:52.713147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ca94fb7a2044b2b1ee2d0b371feea3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:52.717223 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:52.735058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 904/1805] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:52.737709 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca459e-7885-4f77-8a65-e4f2d54f3481 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:52.741365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-36ca459e-7885-4f77-8a65-e4f2d54f3481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:52.771763 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca459e-7885-4f77-8a65-e4f2d54f3481 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:52.783659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:52.784940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:52.786745 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:52.788640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] PATH_INFO: `/v3/projects/0b2e09036d6543d9b2264e62fd0cf554` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:52.792465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2e09036d6543d9b2264e62fd0cf554)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:52.797231 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:52.829901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ca94fb7a2044b2b1ee2d0b371feea3', 'request_id': 'req-ff81688b-0a12-4d17-bad6-c823b848b071'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:52.846102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ca94fb7a2044b2b1ee2d0b371feea3', 'request_id': 'req-ff81688b-0a12-4d17-bad6-c823b848b071'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:52.856517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ca94fb7a2044b2b1ee2d0b371feea3', 'request_id': 'req-ff81688b-0a12-4d17-bad6-c823b848b071'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:52.896332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] The token cache is being invalidate because project e8ca94fb7a2044b2b1ee2d0b371feea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:52.897330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:52.900565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:52.904014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 902/1806] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:52 2022] DELETE /identity/v3/projects/e8ca94fb7a2044b2b1ee2d0b371feea3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:52.910400 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:52.924007 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:52.931373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2e09036d6543d9b2264e62fd0cf554', 'request_id': 'req-2fe2b122-c09f-4450-bab5-dd05400343fe'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:52.944769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2e09036d6543d9b2264e62fd0cf554', 'request_id': 'req-2fe2b122-c09f-4450-bab5-dd05400343fe'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:52.969328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2e09036d6543d9b2264e62fd0cf554', 'request_id': 'req-2fe2b122-c09f-4450-bab5-dd05400343fe'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:52.987216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] The token cache is being invalidate because project 0b2e09036d6543d9b2264e62fd0cf554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:52.987627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:52.988909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2fe2b122-c09f-4450-bab5-dd05400343fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:52.993706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 905/1807] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:52 2022] DELETE /identity/v3/projects/0b2e09036d6543d9b2264e62fd0cf554 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:52.999879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695365-6e7c-45c9-bd53-dd3bed5e52af None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:53.000200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695365-6e7c-45c9-bd53-dd3bed5e52af None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:53.000441 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695365-6e7c-45c9-bd53-dd3bed5e52af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:53.042778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-44695365-6e7c-45c9-bd53-dd3bed5e52af None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:53.044147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-44695365-6e7c-45c9-bd53-dd3bed5e52af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:53.097135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81688b-0a12-4d17-bad6-c823b848b071 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:53.183390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 906/1808] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:53.192635 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5709c-62b2-4d53-90be-895d6927e569 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:53.192924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5709c-62b2-4d53-90be-895d6927e569 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:53.193206 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5709c-62b2-4d53-90be-895d6927e569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:53.211567 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:53.213026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:53.213506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:53.214603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] PATH_INFO: `/v3/users/2abca90add764283a2535babd896cc8d` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:53.216217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2abca90add764283a2535babd896cc8d)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:53.219141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:53.249095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-dce5709c-62b2-4d53-90be-895d6927e569 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:53.250325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-dce5709c-62b2-4d53-90be-895d6927e569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:53.270792 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 907/1809] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:53.275228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5709c-62b2-4d53-90be-895d6927e569 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:53.291209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5709c-62b2-4d53-90be-895d6927e569 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:53.306964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84cb0-5049-45a2-9ecd-eea9322baa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:53.308674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84cb0-5049-45a2-9ecd-eea9322baa03 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:53.309162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84cb0-5049-45a2-9ecd-eea9322baa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:53.309641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84cb0-5049-45a2-9ecd-eea9322baa03 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:53.311679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c84cb0-5049-45a2-9ecd-eea9322baa03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:53.312205 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c84cb0-5049-45a2-9ecd-eea9322baa03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:53.318476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c84cb0-5049-45a2-9ecd-eea9322baa03 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:53.342455 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2abca90add764283a2535babd896cc8d'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:53.354181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 908/1810] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:50:53.357813 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84cb0-5049-45a2-9ecd-eea9322baa03 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:53.361177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2abca90add764283a2535babd896cc8d'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:53.372192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2abca90add764283a2535babd896cc8d'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:53.372952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84cb0-5049-45a2-9ecd-eea9322baa03 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:53.384744 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bb435-372d-4853-8a28-20dbfaea96c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:53.385450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bb435-372d-4853-8a28-20dbfaea96c6 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:53.385737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bb435-372d-4853-8a28-20dbfaea96c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:53.386012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bb435-372d-4853-8a28-20dbfaea96c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:53.386729 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bb435-372d-4853-8a28-20dbfaea96c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:53.388341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2abca90add764283a2535babd896cc8d'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:53.388674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bb435-372d-4853-8a28-20dbfaea96c6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:53.389655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2abca90add764283a2535babd896cc8d'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:53.397878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 903/1811] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:52 2022] DELETE /identity/v3/users/2abca90add764283a2535babd896cc8d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:53.441938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 909/1812] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:53 2022] POST /identity/v3/projects => generated 384 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:53.446470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:53.448463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:53.522853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50bb39-6eb4-4b12-a0c5-2634ee352ec9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:53.596349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a454ee1-dda8-47db-acce-d117d469760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:53.597488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a454ee1-dda8-47db-acce-d117d469760e admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:53.597783 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a454ee1-dda8-47db-acce-d117d469760e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:53.598064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a454ee1-dda8-47db-acce-d117d469760e admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:53.598857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a454ee1-dda8-47db-acce-d117d469760e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:53.601646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a454ee1-dda8-47db-acce-d117d469760e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:53.638575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 904/1813] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:53 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:53.640136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bb435-372d-4853-8a28-20dbfaea96c6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:53.656135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bb435-372d-4853-8a28-20dbfaea96c6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:53.670368 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9271d36-b6fa-440b-9857-880550c78fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:53.671169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9271d36-b6fa-440b-9857-880550c78fec admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:53.671540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9271d36-b6fa-440b-9857-880550c78fec admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:53.671887 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9271d36-b6fa-440b-9857-880550c78fec admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:53.672712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9271d36-b6fa-440b-9857-880550c78fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:53.674505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9271d36-b6fa-440b-9857-880550c78fec admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:53.686223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 910/1814] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:53 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:53.690301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a454ee1-dda8-47db-acce-d117d469760e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:53.703779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a454ee1-dda8-47db-acce-d117d469760e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:53.709572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f37591-728f-4ce5-b565-948eb5911e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:53.710433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f37591-728f-4ce5-b565-948eb5911e50 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:53.710893 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f37591-728f-4ce5-b565-948eb5911e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:53.711385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f37591-728f-4ce5-b565-948eb5911e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:53.712710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f37591-728f-4ce5-b565-948eb5911e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:53.714496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f37591-728f-4ce5-b565-948eb5911e50 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:53.728798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 905/1815] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:53 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:53.732821 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9271d36-b6fa-440b-9857-880550c78fec admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:53.756494 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9271d36-b6fa-440b-9857-880550c78fec admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:53.768012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ec972-726a-480e-b239-d8c5eeb3b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:53.768921 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ec972-726a-480e-b239-d8c5eeb3b54d admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:53.769202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ec972-726a-480e-b239-d8c5eeb3b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:53.769474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ec972-726a-480e-b239-d8c5eeb3b54d admin admin] PATH_INFO: `/v3/projects/41e09c2993af4866bca8ddeaa841d9f4/users/3edae66758174d05a6ad171062d5b47e/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:53.798836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ec972-726a-480e-b239-d8c5eeb3b54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e09c2993af4866bca8ddeaa841d9f4, user_id=3edae66758174d05a6ad171062d5b47e, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:53.802961 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ec972-726a-480e-b239-d8c5eeb3b54d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:53.839905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 911/1816] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:53 2022] PUT /identity/v3/projects/41e09c2993af4866bca8ddeaa841d9f4/users/3edae66758174d05a6ad171062d5b47e/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:53.851029 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd65a2-fc01-4290-b556-fdc33efcd0f2 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:53.851560 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd65a2-fc01-4290-b556-fdc33efcd0f2 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:53.852617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd65a2-fc01-4290-b556-fdc33efcd0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:53.903794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-39bd65a2-fc01-4290-b556-fdc33efcd0f2 None None] MFA Rules not processed for user `3edae66758174d05a6ad171062d5b47e`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:53.905101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-39bd65a2-fc01-4290-b556-fdc33efcd0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:54.013612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 906/1817] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:54.017718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ec972-726a-480e-b239-d8c5eeb3b54d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:54.100800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ec972-726a-480e-b239-d8c5eeb3b54d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:54.106804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901597f-0dcb-4192-9bdf-9b0a04ea5f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:54.107485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901597f-0dcb-4192-9bdf-9b0a04ea5f2a admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.107771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901597f-0dcb-4192-9bdf-9b0a04ea5f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.108049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901597f-0dcb-4192-9bdf-9b0a04ea5f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.108901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901597f-0dcb-4192-9bdf-9b0a04ea5f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:54.111454 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901597f-0dcb-4192-9bdf-9b0a04ea5f2a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:54.146789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 912/1818] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:54 2022] POST /identity/v3/projects => generated 384 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:50:54.151126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd65a2-fc01-4290-b556-fdc33efcd0f2 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:54.162328 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd65a2-fc01-4290-b556-fdc33efcd0f2 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:54.251268 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728b063-1e51-4186-9e3c-6dacc08ea55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:54.252114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728b063-1e51-4186-9e3c-6dacc08ea55e admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.252640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728b063-1e51-4186-9e3c-6dacc08ea55e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.253016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728b063-1e51-4186-9e3c-6dacc08ea55e admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.253854 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728b063-1e51-4186-9e3c-6dacc08ea55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:54.255985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728b063-1e51-4186-9e3c-6dacc08ea55e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:54.289081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 907/1819] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:54 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:54.292841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901597f-0dcb-4192-9bdf-9b0a04ea5f2a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:54.308273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901597f-0dcb-4192-9bdf-9b0a04ea5f2a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:54.323537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0c854-f457-40ec-9976-77cda5b777d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:54.324521 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0c854-f457-40ec-9976-77cda5b777d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.325006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0c854-f457-40ec-9976-77cda5b777d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.325459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0c854-f457-40ec-9976-77cda5b777d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.326399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0c854-f457-40ec-9976-77cda5b777d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:54.328212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0c854-f457-40ec-9976-77cda5b777d2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:54.340246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 913/1820] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:54 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:54.344416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728b063-1e51-4186-9e3c-6dacc08ea55e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:54.356723 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728b063-1e51-4186-9e3c-6dacc08ea55e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:54.362084 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f5171-1bf1-404b-9fa8-d3c5e0348118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:54.363473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f5171-1bf1-404b-9fa8-d3c5e0348118 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.363730 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f5171-1bf1-404b-9fa8-d3c5e0348118 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.364005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f5171-1bf1-404b-9fa8-d3c5e0348118 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.364770 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f5171-1bf1-404b-9fa8-d3c5e0348118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:54.366504 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f5171-1bf1-404b-9fa8-d3c5e0348118 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:54.375923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65821ff-99c4-4258-8ff0-331a4c543c14 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.376212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65821ff-99c4-4258-8ff0-331a4c543c14 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.376493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65821ff-99c4-4258-8ff0-331a4c543c14 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.378510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 914/1821] 10.222.0.117 () {54 vars in 926 bytes} [Mon Jan 24 16:50:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:50:54.384595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 908/1822] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:54 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:54.388600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65821ff-99c4-4258-8ff0-331a4c543c14 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:54.405132 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65821ff-99c4-4258-8ff0-331a4c543c14 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:54.421722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2440bb-9d61-46f2-8575-8e84b8272234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:54.422940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2440bb-9d61-46f2-8575-8e84b8272234 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.423228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2440bb-9d61-46f2-8575-8e84b8272234 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.423513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2440bb-9d61-46f2-8575-8e84b8272234 admin admin] PATH_INFO: `/v3/projects/413fc49f62ae45ab9faad74f469617b0/users/285d889ebff54ea79fb4769381dce1fc/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.436819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f5171-1bf1-404b-9fa8-d3c5e0348118 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:54.438607 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-828f5171-1bf1-404b-9fa8-d3c5e0348118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:54.452184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f5171-1bf1-404b-9fa8-d3c5e0348118 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:54.457352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:54.458312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.458594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.458970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] PATH_INFO: `/v3/projects/c492aaca06194ef1a6560e8c2ca0423b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.460612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c492aaca06194ef1a6560e8c2ca0423b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:54.463407 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:54.466489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2440bb-9d61-46f2-8575-8e84b8272234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=413fc49f62ae45ab9faad74f469617b0, user_id=285d889ebff54ea79fb4769381dce1fc, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:54.470233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2440bb-9d61-46f2-8575-8e84b8272234 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:54.495407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 915/1823] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:54 2022] PUT /identity/v3/projects/413fc49f62ae45ab9faad74f469617b0/users/285d889ebff54ea79fb4769381dce1fc/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:54.506197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d0ee7-d936-42c0-83e2-aad8597e0b93 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.507405 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d0ee7-d936-42c0-83e2-aad8597e0b93 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.507830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d0ee7-d936-42c0-83e2-aad8597e0b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.549306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c492aaca06194ef1a6560e8c2ca0423b', 'request_id': 'req-4393bb11-7fa0-45d9-b900-75d5453962c0'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:54.562937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c492aaca06194ef1a6560e8c2ca0423b', 'request_id': 'req-4393bb11-7fa0-45d9-b900-75d5453962c0'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:54.565415 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-084d0ee7-d936-42c0-83e2-aad8597e0b93 None None] MFA Rules not processed for user `285d889ebff54ea79fb4769381dce1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:54.568103 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-084d0ee7-d936-42c0-83e2-aad8597e0b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:54.572492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c492aaca06194ef1a6560e8c2ca0423b', 'request_id': 'req-4393bb11-7fa0-45d9-b900-75d5453962c0'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:54.588658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] The token cache is being invalidate because project c492aaca06194ef1a6560e8c2ca0423b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:54.589030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:54.589768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4393bb11-7fa0-45d9-b900-75d5453962c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:54.596216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 909/1824] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:54 2022] DELETE /identity/v3/projects/c492aaca06194ef1a6560e8c2ca0423b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:54.596216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabaf91-121e-4f6b-b775-6fde4b5ca991 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.596216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabaf91-121e-4f6b-b775-6fde4b5ca991 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.596216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabaf91-121e-4f6b-b775-6fde4b5ca991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.619328 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-8eabaf91-121e-4f6b-b775-6fde4b5ca991 None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:54.620722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8eabaf91-121e-4f6b-b775-6fde4b5ca991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:54.669141 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 916/1825] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:54.672081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f04d-c620-4f8d-b083-70e8e5091ece None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.672672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f04d-c620-4f8d-b083-70e8e5091ece None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.673315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f04d-c620-4f8d-b083-70e8e5091ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.698036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a0b5f04d-c620-4f8d-b083-70e8e5091ece None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:54.699325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a0b5f04d-c620-4f8d-b083-70e8e5091ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:54.729386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 910/1826] 10.222.0.117 () {58 vars in 1023 bytes} [Mon Jan 24 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:54.730593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabaf91-121e-4f6b-b775-6fde4b5ca991 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:54.732579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8eabaf91-121e-4f6b-b775-6fde4b5ca991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:54.776822 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 917/1827] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:54.778942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1ab82-4d3f-494b-91e8-68f6ca163386 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.779153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1ab82-4d3f-494b-91e8-68f6ca163386 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.779433 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1ab82-4d3f-494b-91e8-68f6ca163386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.802717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a0a1ab82-4d3f-494b-91e8-68f6ca163386 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:54.804589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a0a1ab82-4d3f-494b-91e8-68f6ca163386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:54.814957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 918/1828] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:54.819970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1ab82-4d3f-494b-91e8-68f6ca163386 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:54.831972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1ab82-4d3f-494b-91e8-68f6ca163386 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:54.838535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed669790-57d9-4405-81c5-8bea31c96c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:54.839870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed669790-57d9-4405-81c5-8bea31c96c83 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.839870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed669790-57d9-4405-81c5-8bea31c96c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.840123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed669790-57d9-4405-81c5-8bea31c96c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.841048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed669790-57d9-4405-81c5-8bea31c96c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:54.841597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed669790-57d9-4405-81c5-8bea31c96c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:54.843328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed669790-57d9-4405-81c5-8bea31c96c83 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:54.856483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 919/1829] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:54.863138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed669790-57d9-4405-81c5-8bea31c96c83 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:54.880556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed669790-57d9-4405-81c5-8bea31c96c83 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:54.891556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58626f-eef5-4551-8821-bfee42f0805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:54.894565 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58626f-eef5-4551-8821-bfee42f0805d admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.895259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58626f-eef5-4551-8821-bfee42f0805d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.896452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58626f-eef5-4551-8821-bfee42f0805d admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.897869 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58626f-eef5-4551-8821-bfee42f0805d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:54.899402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabaf91-121e-4f6b-b775-6fde4b5ca991 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:54.904614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58626f-eef5-4551-8821-bfee42f0805d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:54.913963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525c42b-39af-431b-86af-bd9d8d969ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:54.914877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525c42b-39af-431b-86af-bd9d8d969ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:54.915274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525c42b-39af-431b-86af-bd9d8d969ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:54.915652 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525c42b-39af-431b-86af-bd9d8d969ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:54.916560 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525c42b-39af-431b-86af-bd9d8d969ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:54.921470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525c42b-39af-431b-86af-bd9d8d969ef8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:54.961060 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 920/1830] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:54 2022] POST /identity/v3/projects => generated 384 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:54.975527 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58626f-eef5-4551-8821-bfee42f0805d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:54.990809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 911/1831] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:54 2022] POST /identity/v3/projects => generated 384 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:54.993033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525c42b-39af-431b-86af-bd9d8d969ef8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:54.996376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7525c42b-39af-431b-86af-bd9d8d969ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:55.050087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58626f-eef5-4551-8821-bfee42f0805d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.084275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525c42b-39af-431b-86af-bd9d8d969ef8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.091940 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7517cf5-4394-4d52-9cbf-51a93d91aa2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:55.092598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517cf5-4394-4d52-9cbf-51a93d91aa2d service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.092879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517cf5-4394-4d52-9cbf-51a93d91aa2d service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.093154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517cf5-4394-4d52-9cbf-51a93d91aa2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.104695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7517cf5-4394-4d52-9cbf-51a93d91aa2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:55.106245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7517cf5-4394-4d52-9cbf-51a93d91aa2d service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:55.120038 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 912/1832] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:55.120740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7517cf5-4394-4d52-9cbf-51a93d91aa2d service nova] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:55.122257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42215e94-7764-48ba-b220-f765fc7c344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:55.123138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42215e94-7764-48ba-b220-f765fc7c344f admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.123513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42215e94-7764-48ba-b220-f765fc7c344f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.123863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42215e94-7764-48ba-b220-f765fc7c344f admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.124649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42215e94-7764-48ba-b220-f765fc7c344f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:55.127128 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42215e94-7764-48ba-b220-f765fc7c344f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:55.131294 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7517cf5-4394-4d52-9cbf-51a93d91aa2d service nova] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.139432 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fdcda-3a8e-4b8f-83ca-90f897e7b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:55.140088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fdcda-3a8e-4b8f-83ca-90f897e7b23e admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.140405 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fdcda-3a8e-4b8f-83ca-90f897e7b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.140654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fdcda-3a8e-4b8f-83ca-90f897e7b23e admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.141369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fdcda-3a8e-4b8f-83ca-90f897e7b23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:55.143337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fdcda-3a8e-4b8f-83ca-90f897e7b23e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:55.161196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 921/1833] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:54 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:55.162861 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42215e94-7764-48ba-b220-f765fc7c344f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:55.166398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-42215e94-7764-48ba-b220-f765fc7c344f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:55.171849 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 913/1834] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:55 2022] POST /identity/v3/users => generated 299 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:55.172936 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fdcda-3a8e-4b8f-83ca-90f897e7b23e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:55.186080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fdcda-3a8e-4b8f-83ca-90f897e7b23e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.187042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42215e94-7764-48ba-b220-f765fc7c344f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.192505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:55.193059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2629f36-07ba-4d33-9069-5a7dda65ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:55.193913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.194204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.194305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629f36-07ba-4d33-9069-5a7dda65ba46 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.194479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] PATH_INFO: `/v3/users/b359098928524e869cf3ffe527902ff4` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.194978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629f36-07ba-4d33-9069-5a7dda65ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.195575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629f36-07ba-4d33-9069-5a7dda65ba46 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.196523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b359098928524e869cf3ffe527902ff4)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:55.197003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2629f36-07ba-4d33-9069-5a7dda65ba46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:55.198852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2629f36-07ba-4d33-9069-5a7dda65ba46 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:55.199492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:55.226028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 914/1835] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:55 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:55.227803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2629f36-07ba-4d33-9069-5a7dda65ba46 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:55.244111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2629f36-07ba-4d33-9069-5a7dda65ba46 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.258343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe975fb-04b3-40d5-bf14-e99724f8f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:55.259788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe975fb-04b3-40d5-bf14-e99724f8f2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.260924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe975fb-04b3-40d5-bf14-e99724f8f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.261653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe975fb-04b3-40d5-bf14-e99724f8f2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.263806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe975fb-04b3-40d5-bf14-e99724f8f2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:55.265770 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe975fb-04b3-40d5-bf14-e99724f8f2c6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:55.282101 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b359098928524e869cf3ffe527902ff4'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:55.283617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 915/1836] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:55 2022] GET /identity/v3/roles => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:55.284688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe975fb-04b3-40d5-bf14-e99724f8f2c6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:55.299140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe975fb-04b3-40d5-bf14-e99724f8f2c6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.301587 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b359098928524e869cf3ffe527902ff4'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:55.302323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b359098928524e869cf3ffe527902ff4'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:55.302977 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b359098928524e869cf3ffe527902ff4'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:55.309423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40fd4-4778-4384-9a41-e4e76221573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:55.311117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40fd4-4778-4384-9a41-e4e76221573e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.311728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40fd4-4778-4384-9a41-e4e76221573e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.312421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40fd4-4778-4384-9a41-e4e76221573e admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.314489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a40fd4-4778-4384-9a41-e4e76221573e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:55.315320 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b359098928524e869cf3ffe527902ff4'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:55.318105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a40fd4-4778-4384-9a41-e4e76221573e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:55.332694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 922/1837] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:55 2022] DELETE /identity/v3/users/b359098928524e869cf3ffe527902ff4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:55.337918 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 916/1838] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:55 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:55.338145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:55.338646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:55.340788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40fd4-4778-4384-9a41-e4e76221573e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:55.346610 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b6a40fd4-4778-4384-9a41-e4e76221573e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:55.383746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40fd4-4778-4384-9a41-e4e76221573e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.458262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cfb60-2887-4c66-8bae-e92d939849ef admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.471423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321326-6d5c-40d2-a057-1b6530143c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:55.474977 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321326-6d5c-40d2-a057-1b6530143c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.475641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321326-6d5c-40d2-a057-1b6530143c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.477216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321326-6d5c-40d2-a057-1b6530143c22 admin admin] PATH_INFO: `/v3/projects/92c4149635ee404dba8eca38d8224d0b/users/e1ca09141b904b8d92792f12da3e9083/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.499396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd795fc3-4ce6-461d-8cff-a12fab1380b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:55.500567 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd795fc3-4ce6-461d-8cff-a12fab1380b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.501111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd795fc3-4ce6-461d-8cff-a12fab1380b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.502768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd795fc3-4ce6-461d-8cff-a12fab1380b6 admin admin] PATH_INFO: `/v3/projects/69de9fd1ee9c4cac8158b42564149a8f/users/f8ad9a86fb774c4f866695a2a33cf71d/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.515878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321326-6d5c-40d2-a057-1b6530143c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c4149635ee404dba8eca38d8224d0b, user_id=e1ca09141b904b8d92792f12da3e9083, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:55.519425 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321326-6d5c-40d2-a057-1b6530143c22 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:55.527767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd795fc3-4ce6-461d-8cff-a12fab1380b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69de9fd1ee9c4cac8158b42564149a8f, user_id=f8ad9a86fb774c4f866695a2a33cf71d, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:55.533092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd795fc3-4ce6-461d-8cff-a12fab1380b6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:55.548468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 923/1839] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:55 2022] PUT /identity/v3/projects/92c4149635ee404dba8eca38d8224d0b/users/e1ca09141b904b8d92792f12da3e9083/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:55.553012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321326-6d5c-40d2-a057-1b6530143c22 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:55.588647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 917/1840] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:55 2022] PUT /identity/v3/projects/69de9fd1ee9c4cac8158b42564149a8f/users/f8ad9a86fb774c4f866695a2a33cf71d/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:55.599724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cabed-1a6c-499c-b71f-81d9f378e9ac None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.600196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cabed-1a6c-499c-b71f-81d9f378e9ac None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.600616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cabed-1a6c-499c-b71f-81d9f378e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.701799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-924cabed-1a6c-499c-b71f-81d9f378e9ac None None] MFA Rules not processed for user `f8ad9a86fb774c4f866695a2a33cf71d`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:55.703495 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-924cabed-1a6c-499c-b71f-81d9f378e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:55.752418 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321326-6d5c-40d2-a057-1b6530143c22 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.822661 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e56be-1eaf-401a-9976-3f8f57ca0a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:55.823746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e56be-1eaf-401a-9976-3f8f57ca0a1c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.823746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e56be-1eaf-401a-9976-3f8f57ca0a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.824125 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e56be-1eaf-401a-9976-3f8f57ca0a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.825103 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e56be-1eaf-401a-9976-3f8f57ca0a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:55.826983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e56be-1eaf-401a-9976-3f8f57ca0a1c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:55.843511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 924/1841] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:55 2022] GET /identity/v3/roles => generated 1427 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:50:55.844535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e56be-1eaf-401a-9976-3f8f57ca0a1c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:55.857090 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e56be-1eaf-401a-9976-3f8f57ca0a1c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.862534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8671e-1953-4594-b937-779ed9a74761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:55.864049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8671e-1953-4594-b937-779ed9a74761 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.864589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 918/1842] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:55.867149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8671e-1953-4594-b937-779ed9a74761 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.867621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8671e-1953-4594-b937-779ed9a74761 admin admin] PATH_INFO: `/v3/projects/92c4149635ee404dba8eca38d8224d0b/users/e1ca09141b904b8d92792f12da3e9083/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.869721 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cabed-1a6c-499c-b71f-81d9f378e9ac None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:55.876025 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8671e-1953-4594-b937-779ed9a74761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c4149635ee404dba8eca38d8224d0b, user_id=e1ca09141b904b8d92792f12da3e9083, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:55.877151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8671e-1953-4594-b937-779ed9a74761 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:55.888125 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cabed-1a6c-499c-b71f-81d9f378e9ac None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:55.903763 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 925/1843] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:55 2022] PUT /identity/v3/projects/92c4149635ee404dba8eca38d8224d0b/users/e1ca09141b904b8d92792f12da3e9083/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:55.908063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cafbe-0164-4560-a125-5d02c8dc95b3 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:55.908344 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cafbe-0164-4560-a125-5d02c8dc95b3 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:55.908617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cafbe-0164-4560-a125-5d02c8dc95b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:55.972016 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-954cafbe-0164-4560-a125-5d02c8dc95b3 None None] MFA Rules not processed for user `e1ca09141b904b8d92792f12da3e9083`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:55.974537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-954cafbe-0164-4560-a125-5d02c8dc95b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:56.025022 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915e4f4-6295-428e-ae92-04bc7d150f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:56.025706 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e4f4-6295-428e-ae92-04bc7d150f06 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:56.025985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e4f4-6295-428e-ae92-04bc7d150f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:56.026255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e4f4-6295-428e-ae92-04bc7d150f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:56.027004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915e4f4-6295-428e-ae92-04bc7d150f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:56.035937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915e4f4-6295-428e-ae92-04bc7d150f06 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:56.110170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 919/1844] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:55 2022] POST /identity/v3/projects => generated 382 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:56.113840 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915e4f4-6295-428e-ae92-04bc7d150f06 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:56.147372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 926/1845] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:56.157979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cafbe-0164-4560-a125-5d02c8dc95b3 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:56.159924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-954cafbe-0164-4560-a125-5d02c8dc95b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:56.233452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915e4f4-6295-428e-ae92-04bc7d150f06 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:56.243993 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96dbe1-9c5e-4019-a053-d4d6abdc5388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:56.246120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96dbe1-9c5e-4019-a053-d4d6abdc5388 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:56.246665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96dbe1-9c5e-4019-a053-d4d6abdc5388 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:56.256126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96dbe1-9c5e-4019-a053-d4d6abdc5388 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:56.259352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96dbe1-9c5e-4019-a053-d4d6abdc5388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:56.261559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96dbe1-9c5e-4019-a053-d4d6abdc5388 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:56.276506 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cafbe-0164-4560-a125-5d02c8dc95b3 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:56.315719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 920/1846] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:56 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:50:56.315719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96dbe1-9c5e-4019-a053-d4d6abdc5388 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:56.323892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dc96dbe1-9c5e-4019-a053-d4d6abdc5388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:56.346658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96dbe1-9c5e-4019-a053-d4d6abdc5388 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:56.356034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:56.357123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:56.357232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:56.357730 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] PATH_INFO: `/v3/projects/5a25f8bf009e4b55b66d738b6411bdd1` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:56.359279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a25f8bf009e4b55b66d738b6411bdd1)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:56.361522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:56.379145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df61cb-8e59-45dd-a597-3bfa6b76fbe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:56.380179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df61cb-8e59-45dd-a597-3bfa6b76fbe8 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:56.380179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df61cb-8e59-45dd-a597-3bfa6b76fbe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:56.380585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df61cb-8e59-45dd-a597-3bfa6b76fbe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:56.383244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-01df61cb-8e59-45dd-a597-3bfa6b76fbe8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:56.469068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a25f8bf009e4b55b66d738b6411bdd1', 'request_id': 'req-70182cfd-9558-4db6-8554-2f75d548efec'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:56.484056 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a25f8bf009e4b55b66d738b6411bdd1', 'request_id': 'req-70182cfd-9558-4db6-8554-2f75d548efec'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:56.487266 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df61cb-8e59-45dd-a597-3bfa6b76fbe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:56.488533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df61cb-8e59-45dd-a597-3bfa6b76fbe8 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:56.492664 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a25f8bf009e4b55b66d738b6411bdd1', 'request_id': 'req-70182cfd-9558-4db6-8554-2f75d548efec'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:56.500519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 927/1847] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:56.501342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df61cb-8e59-45dd-a597-3bfa6b76fbe8 service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:56.513483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] The token cache is being invalidate because project 5a25f8bf009e4b55b66d738b6411bdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:56.514061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df61cb-8e59-45dd-a597-3bfa6b76fbe8 service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:56.514462 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:56.516713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:56.520928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 921/1848] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:56 2022] DELETE /identity/v3/projects/5a25f8bf009e4b55b66d738b6411bdd1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:56.527895 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:56.531184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:56.612539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b0691-6adb-44ef-bc0b-22161b13adcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:56.613438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b0691-6adb-44ef-bc0b-22161b13adcc admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:56.614264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b0691-6adb-44ef-bc0b-22161b13adcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:56.614264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b0691-6adb-44ef-bc0b-22161b13adcc admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:56.614708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b0691-6adb-44ef-bc0b-22161b13adcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:56.616447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b0691-6adb-44ef-bc0b-22161b13adcc admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:56.634316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 928/1849] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:56 2022] GET /identity/v3/roles => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:56.642089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b0691-6adb-44ef-bc0b-22161b13adcc admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:56.646003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-800b0691-6adb-44ef-bc0b-22161b13adcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:56.672009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70182cfd-9558-4db6-8554-2f75d548efec admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:56.678600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b0691-6adb-44ef-bc0b-22161b13adcc admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:56.684302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:56.687586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe018a-5994-4e5d-9f5c-ed9a4d3a60b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:56.687939 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:56.688388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:56.688819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] PATH_INFO: `/v3/users/e266e6dae69841f5b447166a8f77037e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:56.688946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe018a-5994-4e5d-9f5c-ed9a4d3a60b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:56.689319 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe018a-5994-4e5d-9f5c-ed9a4d3a60b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:56.689606 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe018a-5994-4e5d-9f5c-ed9a4d3a60b2 admin admin] PATH_INFO: `/v3/projects/fc49d376b3b146f9a121c5651b2a7e36/users/e0107ef02de146679ae017f54e0c5b93/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:56.692750 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e266e6dae69841f5b447166a8f77037e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:56.695863 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:56.732577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe018a-5994-4e5d-9f5c-ed9a4d3a60b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc49d376b3b146f9a121c5651b2a7e36, user_id=e0107ef02de146679ae017f54e0c5b93, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:56.741169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe018a-5994-4e5d-9f5c-ed9a4d3a60b2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:56.783286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 929/1850] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:56 2022] PUT /identity/v3/projects/fc49d376b3b146f9a121c5651b2a7e36/users/e0107ef02de146679ae017f54e0c5b93/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:56.787817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe018a-5994-4e5d-9f5c-ed9a4d3a60b2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:56.809381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e266e6dae69841f5b447166a8f77037e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:56.826443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e266e6dae69841f5b447166a8f77037e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:56.843826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e266e6dae69841f5b447166a8f77037e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:56.867859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e266e6dae69841f5b447166a8f77037e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:56.869280 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e266e6dae69841f5b447166a8f77037e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:56.877649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 922/1851] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:56 2022] DELETE /identity/v3/users/e266e6dae69841f5b447166a8f77037e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:56.917178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe018a-5994-4e5d-9f5c-ed9a4d3a60b2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:57.040393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1b4d9-c23c-459c-b3c2-b7209c73075b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:57.041196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1b4d9-c23c-459c-b3c2-b7209c73075b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:57.042374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1b4d9-c23c-459c-b3c2-b7209c73075b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:57.042735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1b4d9-c23c-459c-b3c2-b7209c73075b admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:57.043570 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1b4d9-c23c-459c-b3c2-b7209c73075b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:57.046652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1b4d9-c23c-459c-b3c2-b7209c73075b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:57.060987 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 930/1852] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:56 2022] GET /identity/v3/roles => generated 1427 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:57.065372 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:57.067285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:57.083685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cbc8d-a5b2-4b84-b9f4-bbcadb4ebb93 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:57.088050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1b4d9-c23c-459c-b3c2-b7209c73075b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:57.089076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa292d0-f0bf-4408-aa8f-3000f57c27eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:57.089723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9bd1b4d9-c23c-459c-b3c2-b7209c73075b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:57.090077 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa292d0-f0bf-4408-aa8f-3000f57c27eb admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:57.090529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa292d0-f0bf-4408-aa8f-3000f57c27eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:57.090847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa292d0-f0bf-4408-aa8f-3000f57c27eb admin admin] PATH_INFO: `/v3/projects/fc49d376b3b146f9a121c5651b2a7e36/users/e0107ef02de146679ae017f54e0c5b93/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:57.092975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa292d0-f0bf-4408-aa8f-3000f57c27eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc49d376b3b146f9a121c5651b2a7e36, user_id=e0107ef02de146679ae017f54e0c5b93, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:57.095784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa292d0-f0bf-4408-aa8f-3000f57c27eb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:57.112586 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 923/1853] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:57 2022] PUT /identity/v3/projects/fc49d376b3b146f9a121c5651b2a7e36/users/e0107ef02de146679ae017f54e0c5b93/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:57.123192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1b4d9-c23c-459c-b3c2-b7209c73075b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:57.129209 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9472486-aaf5-4c46-8b7e-90eabc1b793a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:57.131960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9472486-aaf5-4c46-8b7e-90eabc1b793a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:57.133710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9472486-aaf5-4c46-8b7e-90eabc1b793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:57.180207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a9472486-aaf5-4c46-8b7e-90eabc1b793a None None] MFA Rules not processed for user `e0107ef02de146679ae017f54e0c5b93`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:57.181838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a9472486-aaf5-4c46-8b7e-90eabc1b793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:57.279885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:57.282815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:57.283104 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:57.284245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] PATH_INFO: `/v3/projects/d790c2c4a1084711a335817276ffcdd7` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:57.294057 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d790c2c4a1084711a335817276ffcdd7)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:57.299309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:57.408340 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 924/1854] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:57.409855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9472486-aaf5-4c46-8b7e-90eabc1b793a None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:57.411617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a9472486-aaf5-4c46-8b7e-90eabc1b793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:57.469656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd790c2c4a1084711a335817276ffcdd7', 'request_id': 'req-1d98999c-762e-4c49-94ab-5d105b41a432'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:57.482026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd790c2c4a1084711a335817276ffcdd7', 'request_id': 'req-1d98999c-762e-4c49-94ab-5d105b41a432'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:57.495434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd790c2c4a1084711a335817276ffcdd7', 'request_id': 'req-1d98999c-762e-4c49-94ab-5d105b41a432'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:57.509110 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9472486-aaf5-4c46-8b7e-90eabc1b793a None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:57.516971 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] The token cache is being invalidate because project d790c2c4a1084711a335817276ffcdd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:50:57.517772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:57.518714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1d98999c-762e-4c49-94ab-5d105b41a432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:57.521896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 931/1855] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:50:57 2022] DELETE /identity/v3/projects/d790c2c4a1084711a335817276ffcdd7 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:50:57.528130 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122102f2-e3ad-41a8-9730-c51fb5a173ec None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:57.528721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122102f2-e3ad-41a8-9730-c51fb5a173ec None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:57.531087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122102f2-e3ad-41a8-9730-c51fb5a173ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:57.580471 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-122102f2-e3ad-41a8-9730-c51fb5a173ec None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:57.583815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-122102f2-e3ad-41a8-9730-c51fb5a173ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:57.605453 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ea8bc-d1f6-44e9-92d0-d0e02e3c9147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:57.606266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ea8bc-d1f6-44e9-92d0-d0e02e3c9147 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:57.606654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ea8bc-d1f6-44e9-92d0-d0e02e3c9147 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:57.607374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ea8bc-d1f6-44e9-92d0-d0e02e3c9147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:57.609600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-333ea8bc-d1f6-44e9-92d0-d0e02e3c9147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:57.707967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 932/1856] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:57.717167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165a54b-1b79-4560-b593-4efaad43f2a7 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:57.718519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165a54b-1b79-4560-b593-4efaad43f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:57.718815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165a54b-1b79-4560-b593-4efaad43f2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:57.756757 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-c165a54b-1b79-4560-b593-4efaad43f2a7 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:57.758930 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c165a54b-1b79-4560-b593-4efaad43f2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:57.774790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 933/1857] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:57.778038 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165a54b-1b79-4560-b593-4efaad43f2a7 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:57.793318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165a54b-1b79-4560-b593-4efaad43f2a7 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:57.803350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03294cf8-f2bb-4391-9e7b-578c0271e6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:57.803668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ea8bc-d1f6-44e9-92d0-d0e02e3c9147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:57.804082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294cf8-f2bb-4391-9e7b-578c0271e6da admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:57.804370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294cf8-f2bb-4391-9e7b-578c0271e6da admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:57.805309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294cf8-f2bb-4391-9e7b-578c0271e6da admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:57.806097 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03294cf8-f2bb-4391-9e7b-578c0271e6da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:50:57.806406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03294cf8-f2bb-4391-9e7b-578c0271e6da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:57.806608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ea8bc-d1f6-44e9-92d0-d0e02e3c9147 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:57.808412 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03294cf8-f2bb-4391-9e7b-578c0271e6da admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:57.827440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 925/1858] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:57.828411 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ea8bc-d1f6-44e9-92d0-d0e02e3c9147 service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:57.833311 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 934/1859] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:50:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:50:57.851247 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ea8bc-d1f6-44e9-92d0-d0e02e3c9147 service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:57.856879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d4596-2f61-41c5-a5c6-0b3cf9ad4cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:57.857545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d4596-2f61-41c5-a5c6-0b3cf9ad4cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:57.857828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d4596-2f61-41c5-a5c6-0b3cf9ad4cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:57.858108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d4596-2f61-41c5-a5c6-0b3cf9ad4cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:57.858851 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d4596-2f61-41c5-a5c6-0b3cf9ad4cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:57.860845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d4596-2f61-41c5-a5c6-0b3cf9ad4cd9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:57.902943 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 926/1860] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:57 2022] POST /identity/v3/projects => generated 366 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:57.912338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03294cf8-f2bb-4391-9e7b-578c0271e6da admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:57.923736 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03294cf8-f2bb-4391-9e7b-578c0271e6da admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:57.946648 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d4596-2f61-41c5-a5c6-0b3cf9ad4cd9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:57.949281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9a4d4596-2f61-41c5-a5c6-0b3cf9ad4cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:58.057051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d4596-2f61-41c5-a5c6-0b3cf9ad4cd9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:58.070294 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97828442-165b-47f3-9fba-85c42bc34f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:58.071500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828442-165b-47f3-9fba-85c42bc34f6c service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:58.071879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828442-165b-47f3-9fba-85c42bc34f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:58.072170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828442-165b-47f3-9fba-85c42bc34f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:58.083691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-97828442-165b-47f3-9fba-85c42bc34f6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:58.114054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd71e32-4f24-48bf-8957-926998432282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:58.114769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd71e32-4f24-48bf-8957-926998432282 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:58.115058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd71e32-4f24-48bf-8957-926998432282 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:58.117626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd71e32-4f24-48bf-8957-926998432282 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:58.118533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd71e32-4f24-48bf-8957-926998432282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:58.138946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd71e32-4f24-48bf-8957-926998432282 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:58.202159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 935/1861] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:57 2022] POST /identity/v3/users => generated 284 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:58.203130 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd71e32-4f24-48bf-8957-926998432282 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:58.239321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd71e32-4f24-48bf-8957-926998432282 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:58.267066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e80f1f-1abb-4cd6-92a7-0f793af3201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:58.267778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e80f1f-1abb-4cd6-92a7-0f793af3201c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:58.268019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e80f1f-1abb-4cd6-92a7-0f793af3201c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:58.268299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e80f1f-1abb-4cd6-92a7-0f793af3201c admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:58.271968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e80f1f-1abb-4cd6-92a7-0f793af3201c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:58.273708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e80f1f-1abb-4cd6-92a7-0f793af3201c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:58.301969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 936/1862] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:58 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:58.303002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e80f1f-1abb-4cd6-92a7-0f793af3201c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:58.313289 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97828442-165b-47f3-9fba-85c42bc34f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:58.315154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97828442-165b-47f3-9fba-85c42bc34f6c service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:58.317107 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e80f1f-1abb-4cd6-92a7-0f793af3201c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:58.323707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62b88a-0cd5-4c8d-a873-889e2bed984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:58.327817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b88a-0cd5-4c8d-a873-889e2bed984e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:58.328420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b88a-0cd5-4c8d-a873-889e2bed984e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:58.331431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b88a-0cd5-4c8d-a873-889e2bed984e admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:58.337065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62b88a-0cd5-4c8d-a873-889e2bed984e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:58.338686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62b88a-0cd5-4c8d-a873-889e2bed984e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:58.339033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 927/1863] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:50:58.361601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 937/1864] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:58 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:58.362926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97828442-165b-47f3-9fba-85c42bc34f6c service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:58.374007 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62b88a-0cd5-4c8d-a873-889e2bed984e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:58.375088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97828442-165b-47f3-9fba-85c42bc34f6c service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:58.376753 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4b62b88a-0cd5-4c8d-a873-889e2bed984e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:58.380429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e570399-e51c-430c-97ad-43b559a075bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:58.381448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570399-e51c-430c-97ad-43b559a075bc admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:58.381834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570399-e51c-430c-97ad-43b559a075bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:58.388128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570399-e51c-430c-97ad-43b559a075bc admin admin] PATH_INFO: `/v3/projects/94147b12b42b4d04b3c301abd174ee76/users/629a86fee6ed4e15a58b37995edb4a11/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:58.391757 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62b88a-0cd5-4c8d-a873-889e2bed984e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:58.395665 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94049d0-70f1-45f2-8a93-4e79aaa722e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:58.396905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94049d0-70f1-45f2-8a93-4e79aaa722e0 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:58.397491 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94049d0-70f1-45f2-8a93-4e79aaa722e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:58.398000 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94049d0-70f1-45f2-8a93-4e79aaa722e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:58.400131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a94049d0-70f1-45f2-8a93-4e79aaa722e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:58.408627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e570399-e51c-430c-97ad-43b559a075bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=94147b12b42b4d04b3c301abd174ee76, user_id=629a86fee6ed4e15a58b37995edb4a11, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:58.415603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e570399-e51c-430c-97ad-43b559a075bc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:58.444090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 928/1865] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:58 2022] PUT /identity/v3/projects/94147b12b42b4d04b3c301abd174ee76/users/629a86fee6ed4e15a58b37995edb4a11/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:58.456311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66843b6-209d-47de-ad90-8fa248d2df73 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:58.456705 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66843b6-209d-47de-ad90-8fa248d2df73 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:58.457337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66843b6-209d-47de-ad90-8fa248d2df73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:58.477140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94049d0-70f1-45f2-8a93-4e79aaa722e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:58.481413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94049d0-70f1-45f2-8a93-4e79aaa722e0 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:58.492040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a66843b6-209d-47de-ad90-8fa248d2df73 None None] MFA Rules not processed for user `629a86fee6ed4e15a58b37995edb4a11`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:58.494184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a66843b6-209d-47de-ad90-8fa248d2df73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:58.520210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 938/1866] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:50:58.580369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 929/1867] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:50:58.586009 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94049d0-70f1-45f2-8a93-4e79aaa722e0 service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:58.597912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94049d0-70f1-45f2-8a93-4e79aaa722e0 service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:58.670783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddd256-eaf1-4ce8-9c34-db5bf6dba717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:58.671527 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddd256-eaf1-4ce8-9c34-db5bf6dba717 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:58.671840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddd256-eaf1-4ce8-9c34-db5bf6dba717 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:58.672192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddd256-eaf1-4ce8-9c34-db5bf6dba717 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:58.673135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ddd256-eaf1-4ce8-9c34-db5bf6dba717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:58.674999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ddd256-eaf1-4ce8-9c34-db5bf6dba717 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:58.716621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 939/1868] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:50:58 2022] POST /identity/v3/projects => generated 366 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:58.721529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66843b6-209d-47de-ad90-8fa248d2df73 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:58.734347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66843b6-209d-47de-ad90-8fa248d2df73 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:58.836738 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363318e5-198a-4a82-8d5d-850234c6a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:58.837533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363318e5-198a-4a82-8d5d-850234c6a6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:58.837870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363318e5-198a-4a82-8d5d-850234c6a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:58.838198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363318e5-198a-4a82-8d5d-850234c6a6d9 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:58.839022 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363318e5-198a-4a82-8d5d-850234c6a6d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:58.841035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363318e5-198a-4a82-8d5d-850234c6a6d9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:58.868847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 930/1869] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:50:58 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:50:58.869857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddd256-eaf1-4ce8-9c34-db5bf6dba717 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:58.886732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddd256-eaf1-4ce8-9c34-db5bf6dba717 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:58.893765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc4dd8-563e-4204-b632-06fd58c3bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:58.894461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc4dd8-563e-4204-b632-06fd58c3bdff admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:58.894739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc4dd8-563e-4204-b632-06fd58c3bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:58.895056 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc4dd8-563e-4204-b632-06fd58c3bdff admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:58.896050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc4dd8-563e-4204-b632-06fd58c3bdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:58.901944 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc4dd8-563e-4204-b632-06fd58c3bdff admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:58.918804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 940/1870] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:58 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:50:58.922725 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363318e5-198a-4a82-8d5d-850234c6a6d9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:58.934167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363318e5-198a-4a82-8d5d-850234c6a6d9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:58.939461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869f235-718a-4bf9-beda-22a1547c3f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:58.940421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869f235-718a-4bf9-beda-22a1547c3f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:58.940785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869f235-718a-4bf9-beda-22a1547c3f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:58.941373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869f235-718a-4bf9-beda-22a1547c3f12 admin admin] PATH_INFO: `/v3/projects/8a65e3a4ddd44685a97e47299b6efd7f/users/b0d23fa509164144ae3c048c417c4277/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:58.959966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869f235-718a-4bf9-beda-22a1547c3f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a65e3a4ddd44685a97e47299b6efd7f, user_id=b0d23fa509164144ae3c048c417c4277, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:58.963629 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869f235-718a-4bf9-beda-22a1547c3f12 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:58.987677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 931/1871] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:58 2022] PUT /identity/v3/projects/8a65e3a4ddd44685a97e47299b6efd7f/users/b0d23fa509164144ae3c048c417c4277/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:58.989192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc4dd8-563e-4204-b632-06fd58c3bdff admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:59.000279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc4dd8-563e-4204-b632-06fd58c3bdff admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:59.073628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353049dd-b8bb-4d02-9991-d26d2e26300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:59.075180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353049dd-b8bb-4d02-9991-d26d2e26300b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:59.075662 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353049dd-b8bb-4d02-9991-d26d2e26300b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:59.076158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353049dd-b8bb-4d02-9991-d26d2e26300b admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:59.077842 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353049dd-b8bb-4d02-9991-d26d2e26300b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:59.081276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353049dd-b8bb-4d02-9991-d26d2e26300b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:59.099767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 941/1872] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:50:58 2022] GET /identity/v3/roles => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:50:59.104236 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869f235-718a-4bf9-beda-22a1547c3f12 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:59.120365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869f235-718a-4bf9-beda-22a1547c3f12 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:59.135821 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99c5a-a012-44e0-b6a3-51ce0f1688fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:59.140184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99c5a-a012-44e0-b6a3-51ce0f1688fa admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:59.141277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99c5a-a012-44e0-b6a3-51ce0f1688fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:59.142899 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99c5a-a012-44e0-b6a3-51ce0f1688fa admin admin] PATH_INFO: `/v3/projects/8a65e3a4ddd44685a97e47299b6efd7f/users/b0d23fa509164144ae3c048c417c4277/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:59.147392 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab99c5a-a012-44e0-b6a3-51ce0f1688fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a65e3a4ddd44685a97e47299b6efd7f, user_id=b0d23fa509164144ae3c048c417c4277, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:59.155283 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab99c5a-a012-44e0-b6a3-51ce0f1688fa admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:59.198845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 932/1873] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:50:59 2022] PUT /identity/v3/projects/8a65e3a4ddd44685a97e47299b6efd7f/users/b0d23fa509164144ae3c048c417c4277/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:50:59.201763 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949d65-95cc-41a3-a111-17f93140d470 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:59.202299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949d65-95cc-41a3-a111-17f93140d470 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:59.202812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949d65-95cc-41a3-a111-17f93140d470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:59.236759 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-76949d65-95cc-41a3-a111-17f93140d470 None None] MFA Rules not processed for user `b0d23fa509164144ae3c048c417c4277`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:50:59.237979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-76949d65-95cc-41a3-a111-17f93140d470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:59.335529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 942/1874] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:50:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:50:59.348376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99c5a-a012-44e0-b6a3-51ce0f1688fa admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:59.422883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99c5a-a012-44e0-b6a3-51ce0f1688fa admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:59.426127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76949d65-95cc-41a3-a111-17f93140d470 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:59.432370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d87d-cf31-4d6d-aabb-4f50894b6a1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:59.433034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d87d-cf31-4d6d-aabb-4f50894b6a1f service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:59.433892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d87d-cf31-4d6d-aabb-4f50894b6a1f service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:59.433892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d87d-cf31-4d6d-aabb-4f50894b6a1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:59.437560 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76949d65-95cc-41a3-a111-17f93140d470 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:59.443884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4eb895-0ff6-4799-9127-2276e2bfe677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:59.443884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb895-0ff6-4799-9127-2276e2bfe677 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:59.443884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb895-0ff6-4799-9127-2276e2bfe677 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:59.443884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb895-0ff6-4799-9127-2276e2bfe677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:59.446067 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873d87d-cf31-4d6d-aabb-4f50894b6a1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:59.446554 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-bb4eb895-0ff6-4799-9127-2276e2bfe677 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:50:59.448758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873d87d-cf31-4d6d-aabb-4f50894b6a1f service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:59.475081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 933/1875] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:50:59.546258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4eb895-0ff6-4799-9127-2276e2bfe677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:59.548564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4eb895-0ff6-4799-9127-2276e2bfe677 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:59.563929 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 943/1876] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:50:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:50:59.700688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d87d-cf31-4d6d-aabb-4f50894b6a1f service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:50:59.791459 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d87d-cf31-4d6d-aabb-4f50894b6a1f service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:50:59.796849 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:50:59.798556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:50:59.799406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:50:59.799406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] PATH_INFO: `/v3/users/629a86fee6ed4e15a58b37995edb4a11` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:50:59.800626 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=629a86fee6ed4e15a58b37995edb4a11)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:50:59.802632 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:50:59.915267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629a86fee6ed4e15a58b37995edb4a11'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:59.937007 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629a86fee6ed4e15a58b37995edb4a11'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:59.977955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629a86fee6ed4e15a58b37995edb4a11'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:59.996691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629a86fee6ed4e15a58b37995edb4a11'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:50:59.998583 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629a86fee6ed4e15a58b37995edb4a11'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:00.015421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 934/1877] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:50:59 2022] DELETE /identity/v3/users/629a86fee6ed4e15a58b37995edb4a11 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:00.016869 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f4d4a-293d-4e06-abb0-f4cea7d8f3af None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:00.017343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f4d4a-293d-4e06-abb0-f4cea7d8f3af None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:00.017488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f4d4a-293d-4e06-abb0-f4cea7d8f3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:00.072564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f43f4d4a-293d-4e06-abb0-f4cea7d8f3af None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:00.078223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f43f4d4a-293d-4e06-abb0-f4cea7d8f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:00.245086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 944/1878] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:00.260153 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:00.263287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:00.380155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78341-00bf-4808-b48d-53e8072f4e59 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:00.391946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577041ec-1aca-4180-b40c-3aa37ac7709e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:00.392905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577041ec-1aca-4180-b40c-3aa37ac7709e service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:00.393338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577041ec-1aca-4180-b40c-3aa37ac7709e service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:00.394498 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577041ec-1aca-4180-b40c-3aa37ac7709e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:00.424017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577041ec-1aca-4180-b40c-3aa37ac7709e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:00.430278 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577041ec-1aca-4180-b40c-3aa37ac7709e service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:00.458956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 935/1879] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:01.010691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f4d4a-293d-4e06-abb0-f4cea7d8f3af None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:01.015534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f43f4d4a-293d-4e06-abb0-f4cea7d8f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:01.080130 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f4d4a-293d-4e06-abb0-f4cea7d8f3af None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:01.098813 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:01.099845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:01.100197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:01.100629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] PATH_INFO: `/v3/projects/94147b12b42b4d04b3c301abd174ee76` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:01.105745 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94147b12b42b4d04b3c301abd174ee76)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:01.108386 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:01.205680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94147b12b42b4d04b3c301abd174ee76', 'request_id': 'req-e396787f-7c9c-4bad-8553-da9e64c96827'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.232394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94147b12b42b4d04b3c301abd174ee76', 'request_id': 'req-e396787f-7c9c-4bad-8553-da9e64c96827'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.254315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94147b12b42b4d04b3c301abd174ee76', 'request_id': 'req-e396787f-7c9c-4bad-8553-da9e64c96827'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.275576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] The token cache is being invalidate because project 94147b12b42b4d04b3c301abd174ee76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:01.275876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.277338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.282387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 945/1880] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:01 2022] DELETE /identity/v3/projects/94147b12b42b4d04b3c301abd174ee76 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:01.286578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577041ec-1aca-4180-b40c-3aa37ac7709e service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:01.310681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577041ec-1aca-4180-b40c-3aa37ac7709e service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:01.401636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:01.403411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:01.409000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ce759-9a81-45c0-b22a-4d0ea30aa993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:01.410064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce759-9a81-45c0-b22a-4d0ea30aa993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:01.410449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce759-9a81-45c0-b22a-4d0ea30aa993 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:01.411885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce759-9a81-45c0-b22a-4d0ea30aa993 admin admin] PATH_INFO: `/v3/users/b0d23fa509164144ae3c048c417c4277` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:01.414249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ce759-9a81-45c0-b22a-4d0ea30aa993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d23fa509164144ae3c048c417c4277)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:01.417696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ce759-9a81-45c0-b22a-4d0ea30aa993 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:01.440751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396787f-7c9c-4bad-8553-da9e64c96827 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:01.455221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:01.457240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:01.457528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:01.458183 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] PATH_INFO: `/v3/users/f8ad9a86fb774c4f866695a2a33cf71d` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:01.460341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ad9a86fb774c4f866695a2a33cf71d)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:01.464149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:01.501774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7a4ce759-9a81-45c0-b22a-4d0ea30aa993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d23fa509164144ae3c048c417c4277'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.515443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7a4ce759-9a81-45c0-b22a-4d0ea30aa993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d23fa509164144ae3c048c417c4277'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.535984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7a4ce759-9a81-45c0-b22a-4d0ea30aa993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d23fa509164144ae3c048c417c4277'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.547622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ad9a86fb774c4f866695a2a33cf71d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.551031 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7a4ce759-9a81-45c0-b22a-4d0ea30aa993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d23fa509164144ae3c048c417c4277'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.551846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7a4ce759-9a81-45c0-b22a-4d0ea30aa993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d23fa509164144ae3c048c417c4277'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.563825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 936/1881] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:01 2022] DELETE /identity/v3/users/b0d23fa509164144ae3c048c417c4277 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:01.577404 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ad9a86fb774c4f866695a2a33cf71d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.583241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ad9a86fb774c4f866695a2a33cf71d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.587084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ad9a86fb774c4f866695a2a33cf71d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.599209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ad9a86fb774c4f866695a2a33cf71d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:01.621178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 946/1882] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:01 2022] DELETE /identity/v3/users/f8ad9a86fb774c4f866695a2a33cf71d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:01.626949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef5500-fee2-4b2f-85a6-0f827fc97a4b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:01.627362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef5500-fee2-4b2f-85a6-0f827fc97a4b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:01.627661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef5500-fee2-4b2f-85a6-0f827fc97a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:01.658480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7eef5500-fee2-4b2f-85a6-0f827fc97a4b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:01.659758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7eef5500-fee2-4b2f-85a6-0f827fc97a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:01.741538 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 937/1883] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:01.747263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:01.748751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:01.870286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b97d0-af44-4f79-b90b-fb814136614b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:01.884468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b8157-256f-4033-977c-0147590b328e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:01.886120 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b8157-256f-4033-977c-0147590b328e service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:01.886120 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b8157-256f-4033-977c-0147590b328e service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:01.886359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b8157-256f-4033-977c-0147590b328e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:01.915047 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b8157-256f-4033-977c-0147590b328e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:01.916715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b8157-256f-4033-977c-0147590b328e service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:01.944092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 947/1884] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:02.636105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef5500-fee2-4b2f-85a6-0f827fc97a4b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:02.638989 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7eef5500-fee2-4b2f-85a6-0f827fc97a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:02.667695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef5500-fee2-4b2f-85a6-0f827fc97a4b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:02.688540 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:02.689869 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:02.690298 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:02.690804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] PATH_INFO: `/v3/projects/8a65e3a4ddd44685a97e47299b6efd7f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:02.705284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a65e3a4ddd44685a97e47299b6efd7f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:02.720426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:02.832837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a65e3a4ddd44685a97e47299b6efd7f', 'request_id': 'req-c0f0732a-e853-419c-a792-0061842f5b84'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:02.847931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a65e3a4ddd44685a97e47299b6efd7f', 'request_id': 'req-c0f0732a-e853-419c-a792-0061842f5b84'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:02.863216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a65e3a4ddd44685a97e47299b6efd7f', 'request_id': 'req-c0f0732a-e853-419c-a792-0061842f5b84'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:02.878722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] The token cache is being invalidate because project 8a65e3a4ddd44685a97e47299b6efd7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:02.880327 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:02.881045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:02.882815 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 938/1885] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:02 2022] DELETE /identity/v3/projects/8a65e3a4ddd44685a97e47299b6efd7f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:02.890364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8d2b2-8630-44e7-8422-0e9e75a12746 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:02.891267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8d2b2-8630-44e7-8422-0e9e75a12746 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:02.891735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8d2b2-8630-44e7-8422-0e9e75a12746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:02.912001 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:02.915035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:02.948539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-49e8d2b2-8630-44e7-8422-0e9e75a12746 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:02.953954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-49e8d2b2-8630-44e7-8422-0e9e75a12746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:03.059935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0732a-e853-419c-a792-0061842f5b84 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:03.069180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:03.070594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:03.075057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:03.075376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] PATH_INFO: `/v3/projects/69de9fd1ee9c4cac8158b42564149a8f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:03.077593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69de9fd1ee9c4cac8158b42564149a8f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:03.079705 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:03.096091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 948/1886] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:03.098108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1854d-6f92-4ff1-b123-aec5fcc04dae None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:03.098636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1854d-6f92-4ff1-b123-aec5fcc04dae None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:03.099293 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1854d-6f92-4ff1-b123-aec5fcc04dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:03.126998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-c7e1854d-6f92-4ff1-b123-aec5fcc04dae None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:03.130376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c7e1854d-6f92-4ff1-b123-aec5fcc04dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:03.161934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 949/1887] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:03.177940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1854d-6f92-4ff1-b123-aec5fcc04dae None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:03.189509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1854d-6f92-4ff1-b123-aec5fcc04dae None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:03.197956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69de9fd1ee9c4cac8158b42564149a8f', 'request_id': 'req-ac318c22-bb01-4ada-8373-7adb96058115'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:03.230274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69de9fd1ee9c4cac8158b42564149a8f', 'request_id': 'req-ac318c22-bb01-4ada-8373-7adb96058115'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:03.238105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69de9fd1ee9c4cac8158b42564149a8f', 'request_id': 'req-ac318c22-bb01-4ada-8373-7adb96058115'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:03.250104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] The token cache is being invalidate because project 69de9fd1ee9c4cac8158b42564149a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:03.250480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:03.251131 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:03.255080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 939/1888] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:02 2022] DELETE /identity/v3/projects/69de9fd1ee9c4cac8158b42564149a8f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:51:03.264787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:03.267854 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:03.286598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa183d-d913-4cc9-9cc5-d0e0a41d95c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:03.287364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa183d-d913-4cc9-9cc5-d0e0a41d95c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:03.288058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa183d-d913-4cc9-9cc5-d0e0a41d95c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:03.288058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa183d-d913-4cc9-9cc5-d0e0a41d95c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:03.289351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa183d-d913-4cc9-9cc5-d0e0a41d95c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:03.289884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa183d-d913-4cc9-9cc5-d0e0a41d95c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:03.291783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa183d-d913-4cc9-9cc5-d0e0a41d95c7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:03.343401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 950/1889] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:51:03.353658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa183d-d913-4cc9-9cc5-d0e0a41d95c7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:03.362903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-49aa183d-d913-4cc9-9cc5-d0e0a41d95c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:03.399265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac318c22-bb01-4ada-8373-7adb96058115 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:03.410197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa183d-d913-4cc9-9cc5-d0e0a41d95c7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:03.412942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:03.415120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:03.415904 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:03.416889 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] PATH_INFO: `/v3/users/e0107ef02de146679ae017f54e0c5b93` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:03.419857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0107ef02de146679ae017f54e0c5b93)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:03.424015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7db9d-64f3-4bdb-8d12-7db2485e4f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:03.427716 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7db9d-64f3-4bdb-8d12-7db2485e4f58 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:03.430121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7db9d-64f3-4bdb-8d12-7db2485e4f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:03.430121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7db9d-64f3-4bdb-8d12-7db2485e4f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:03.431461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:03.435001 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7db9d-64f3-4bdb-8d12-7db2485e4f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:03.439577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7db9d-64f3-4bdb-8d12-7db2485e4f58 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:03.511969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 951/1890] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:03 2022] POST /identity/v3/projects => generated 358 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:03.513337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7db9d-64f3-4bdb-8d12-7db2485e4f58 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:03.539216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0107ef02de146679ae017f54e0c5b93'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:03.554232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0107ef02de146679ae017f54e0c5b93'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:03.570691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0107ef02de146679ae017f54e0c5b93'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:03.589158 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0107ef02de146679ae017f54e0c5b93'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:03.592089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0107ef02de146679ae017f54e0c5b93'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:03.608910 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 940/1891] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:03 2022] DELETE /identity/v3/users/e0107ef02de146679ae017f54e0c5b93 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:03.619629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7db9d-64f3-4bdb-8d12-7db2485e4f58 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:03.697515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600a915-383b-48f5-9155-7f5046a9a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:03.698797 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600a915-383b-48f5-9155-7f5046a9a74c admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:03.699182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600a915-383b-48f5-9155-7f5046a9a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:03.699558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600a915-383b-48f5-9155-7f5046a9a74c admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:03.700686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600a915-383b-48f5-9155-7f5046a9a74c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:03.702529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600a915-383b-48f5-9155-7f5046a9a74c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:03.735092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 952/1892] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:03 2022] POST /identity/v3/users => generated 280 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:03.737180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:03.739104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:03.759809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bf4e8-30a7-41a9-8e3f-c76e1dccb9c6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:03.766310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fa255-e03e-4948-a02d-f35a3e97725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:03.767096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fa255-e03e-4948-a02d-f35a3e97725e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:03.767381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fa255-e03e-4948-a02d-f35a3e97725e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:03.767657 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fa255-e03e-4948-a02d-f35a3e97725e admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:03.768578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fa255-e03e-4948-a02d-f35a3e97725e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:03.770290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fa255-e03e-4948-a02d-f35a3e97725e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:03.785455 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 941/1893] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:03 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:51:03.790941 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600a915-383b-48f5-9155-7f5046a9a74c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:03.801940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600a915-383b-48f5-9155-7f5046a9a74c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:03.808240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9b438-21ed-43c8-b665-4acf973af153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:03.809073 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b438-21ed-43c8-b665-4acf973af153 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:03.809575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b438-21ed-43c8-b665-4acf973af153 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:03.810048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b438-21ed-43c8-b665-4acf973af153 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:03.811133 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9b438-21ed-43c8-b665-4acf973af153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:03.814077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9b438-21ed-43c8-b665-4acf973af153 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:03.842493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 953/1894] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:03 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:03.846009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fa255-e03e-4948-a02d-f35a3e97725e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:03.862594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fa255-e03e-4948-a02d-f35a3e97725e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:03.869544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63c39-cb3a-4f16-8be9-0761d6059ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:03.870603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63c39-cb3a-4f16-8be9-0761d6059ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:03.871021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63c39-cb3a-4f16-8be9-0761d6059ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:03.871397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63c39-cb3a-4f16-8be9-0761d6059ffe admin admin] PATH_INFO: `/v3/projects/0120ee4b24f346d180090114159bbaf7/users/640ddae1dd784c7db896217ffeec8d98/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:03.910585 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef63c39-cb3a-4f16-8be9-0761d6059ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0120ee4b24f346d180090114159bbaf7, user_id=640ddae1dd784c7db896217ffeec8d98, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:03.913435 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef63c39-cb3a-4f16-8be9-0761d6059ffe admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:03.935843 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 942/1895] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:03 2022] PUT /identity/v3/projects/0120ee4b24f346d180090114159bbaf7/users/640ddae1dd784c7db896217ffeec8d98/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:03.950694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73853b9d-770f-4334-9613-1a2154d1a771 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:03.951281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73853b9d-770f-4334-9613-1a2154d1a771 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:03.952257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73853b9d-770f-4334-9613-1a2154d1a771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:03.988854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-73853b9d-770f-4334-9613-1a2154d1a771 None None] MFA Rules not processed for user `640ddae1dd784c7db896217ffeec8d98`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:03.990581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-73853b9d-770f-4334-9613-1a2154d1a771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:04.087690 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 954/1896] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:04.092096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63c39-cb3a-4f16-8be9-0761d6059ffe admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:04.159743 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63c39-cb3a-4f16-8be9-0761d6059ffe admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:04.166797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1795102-6422-473c-aa29-ca6e4965584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:04.167501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1795102-6422-473c-aa29-ca6e4965584c admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:04.167786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1795102-6422-473c-aa29-ca6e4965584c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:04.168068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1795102-6422-473c-aa29-ca6e4965584c admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:04.169644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1795102-6422-473c-aa29-ca6e4965584c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:04.171780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1795102-6422-473c-aa29-ca6e4965584c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:04.203017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73853b9d-770f-4334-9613-1a2154d1a771 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:04.205062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-73853b9d-770f-4334-9613-1a2154d1a771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:04.232878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 943/1897] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:04 2022] POST /identity/v3/projects => generated 354 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:04.233887 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1795102-6422-473c-aa29-ca6e4965584c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:04.249825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73853b9d-770f-4334-9613-1a2154d1a771 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:04.402788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:04.403892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:04.404488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:04.404936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] PATH_INFO: `/v3/projects/fc49d376b3b146f9a121c5651b2a7e36` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:04.406463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc49d376b3b146f9a121c5651b2a7e36)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:04.410384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:04.433139 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1795102-6422-473c-aa29-ca6e4965584c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:04.440826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b07277-5d52-4df5-ba4e-e363983384d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:04.441763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b07277-5d52-4df5-ba4e-e363983384d6 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:04.442046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b07277-5d52-4df5-ba4e-e363983384d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:04.442355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b07277-5d52-4df5-ba4e-e363983384d6 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:04.443277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b07277-5d52-4df5-ba4e-e363983384d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:04.445801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b07277-5d52-4df5-ba4e-e363983384d6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:04.497342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 944/1898] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:04 2022] POST /identity/v3/users => generated 284 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:04.499855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b07277-5d52-4df5-ba4e-e363983384d6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:04.503558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c0b07277-5d52-4df5-ba4e-e363983384d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:04.557254 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc49d376b3b146f9a121c5651b2a7e36', 'request_id': 'req-b8217fec-1521-4388-a6fe-7229605c693e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:04.569611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b07277-5d52-4df5-ba4e-e363983384d6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:04.572898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc49d376b3b146f9a121c5651b2a7e36', 'request_id': 'req-b8217fec-1521-4388-a6fe-7229605c693e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:04.588330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc49d376b3b146f9a121c5651b2a7e36', 'request_id': 'req-b8217fec-1521-4388-a6fe-7229605c693e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:04.604701 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] The token cache is being invalidate because project fc49d376b3b146f9a121c5651b2a7e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:04.605663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:04.606368 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:04.612850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 955/1899] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:04 2022] DELETE /identity/v3/projects/fc49d376b3b146f9a121c5651b2a7e36 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:51:04.612850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:04.612850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:04.698727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8217fec-1521-4388-a6fe-7229605c693e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:04.705960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1134a-f177-4e9e-a200-69a481983ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:04.707005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1134a-f177-4e9e-a200-69a481983ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:04.707524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1134a-f177-4e9e-a200-69a481983ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:04.708104 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1134a-f177-4e9e-a200-69a481983ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:04.709123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1134a-f177-4e9e-a200-69a481983ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:04.711247 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1134a-f177-4e9e-a200-69a481983ae3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:04.716166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:04.719258 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:04.719555 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:04.720450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] PATH_INFO: `/v3/users/3edae66758174d05a6ad171062d5b47e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:04.723934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3edae66758174d05a6ad171062d5b47e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:04.726338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 956/1900] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:04 2022] GET /identity/v3/roles => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:04.726459 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:04.728297 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb6efd-5e7f-41d0-8c4d-3ff819db7067 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:04.728849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb6efd-5e7f-41d0-8c4d-3ff819db7067 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:04.730175 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb6efd-5e7f-41d0-8c4d-3ff819db7067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:04.755759 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-cfeb6efd-5e7f-41d0-8c4d-3ff819db7067 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:04.757161 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-cfeb6efd-5e7f-41d0-8c4d-3ff819db7067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:04.768330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 957/1901] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:04.769387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb6efd-5e7f-41d0-8c4d-3ff819db7067 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:04.784139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb6efd-5e7f-41d0-8c4d-3ff819db7067 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:04.792349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28679092-08ec-4e68-a391-7828af675b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:04.793360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28679092-08ec-4e68-a391-7828af675b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:04.793703 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28679092-08ec-4e68-a391-7828af675b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:04.793986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28679092-08ec-4e68-a391-7828af675b23 admin admin] PATH_INFO: `/v3/projects/b0e4be9ae5654aa897b13466d248bfb6/users/2bb79e88ad6440b0987ee396c89fed9c/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:04.805542 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3edae66758174d05a6ad171062d5b47e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:04.814582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28679092-08ec-4e68-a391-7828af675b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e4be9ae5654aa897b13466d248bfb6, user_id=2bb79e88ad6440b0987ee396c89fed9c, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:04.815531 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3edae66758174d05a6ad171062d5b47e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:04.819272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28679092-08ec-4e68-a391-7828af675b23 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:04.825599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3edae66758174d05a6ad171062d5b47e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:04.842282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3edae66758174d05a6ad171062d5b47e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:04.843214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3edae66758174d05a6ad171062d5b47e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:04.847901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 958/1902] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:04 2022] PUT /identity/v3/projects/b0e4be9ae5654aa897b13466d248bfb6/users/2bb79e88ad6440b0987ee396c89fed9c/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:04.850193 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc855d7-4981-450c-bf2a-5176bc771e05 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:04.852730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc855d7-4981-450c-bf2a-5176bc771e05 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:04.855303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 945/1903] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:04 2022] DELETE /identity/v3/users/3edae66758174d05a6ad171062d5b47e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:04.855453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc855d7-4981-450c-bf2a-5176bc771e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:04.855671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:04.857180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:04.875218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ecc855d7-4981-450c-bf2a-5176bc771e05 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:04.876065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ecc855d7-4981-450c-bf2a-5176bc771e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:04.933049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62268552-17e8-424a-9407-afad12e91dd3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:04.938390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c904a-0263-4b76-82d7-721271f51a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:04.939104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c904a-0263-4b76-82d7-721271f51a7f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:04.939573 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c904a-0263-4b76-82d7-721271f51a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:04.939863 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c904a-0263-4b76-82d7-721271f51a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:04.940715 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c904a-0263-4b76-82d7-721271f51a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:04.942960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c904a-0263-4b76-82d7-721271f51a7f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:04.954796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 959/1904] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:04.955415 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 946/1905] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:04 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:04.956904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0febf4f-4a1e-4bea-bf7b-6fa56f22ac4d None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:04.957350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0febf4f-4a1e-4bea-bf7b-6fa56f22ac4d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:04.957638 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0febf4f-4a1e-4bea-bf7b-6fa56f22ac4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:04.959043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c904a-0263-4b76-82d7-721271f51a7f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:04.971764 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c904a-0263-4b76-82d7-721271f51a7f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:04.978493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f7ba1-c7d6-43eb-acb3-9a4b800f2e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:04.979483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f7ba1-c7d6-43eb-acb3-9a4b800f2e9d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:04.980141 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f7ba1-c7d6-43eb-acb3-9a4b800f2e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:04.980249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d0febf4f-4a1e-4bea-bf7b-6fa56f22ac4d None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:04.980735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f7ba1-c7d6-43eb-acb3-9a4b800f2e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:04.981589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d0febf4f-4a1e-4bea-bf7b-6fa56f22ac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:04.981971 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f7ba1-c7d6-43eb-acb3-9a4b800f2e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:04.982478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f7ba1-c7d6-43eb-acb3-9a4b800f2e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:04.984468 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f7ba1-c7d6-43eb-acb3-9a4b800f2e9d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:04.994538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 960/1906] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:04.994538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0febf4f-4a1e-4bea-bf7b-6fa56f22ac4d None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.003090 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0febf4f-4a1e-4bea-bf7b-6fa56f22ac4d None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:05.010020 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827705d-137f-4631-bc82-e07f99ad086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:05.010904 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 947/1907] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:51:05.011029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827705d-137f-4631-bc82-e07f99ad086b admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.011191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827705d-137f-4631-bc82-e07f99ad086b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.011601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827705d-137f-4631-bc82-e07f99ad086b admin admin] PATH_INFO: `/v3/projects/b0e4be9ae5654aa897b13466d248bfb6/users/2bb79e88ad6440b0987ee396c89fed9c/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.012486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f7ba1-c7d6-43eb-acb3-9a4b800f2e9d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.014458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827705d-137f-4631-bc82-e07f99ad086b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e4be9ae5654aa897b13466d248bfb6, user_id=2bb79e88ad6440b0987ee396c89fed9c, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:05.014779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c51f7ba1-c7d6-43eb-acb3-9a4b800f2e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:05.017269 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827705d-137f-4631-bc82-e07f99ad086b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:05.032973 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 961/1908] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:04 2022] PUT /identity/v3/projects/b0e4be9ae5654aa897b13466d248bfb6/users/2bb79e88ad6440b0987ee396c89fed9c/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:05.034194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827705d-137f-4631-bc82-e07f99ad086b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.101431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f7ba1-c7d6-43eb-acb3-9a4b800f2e9d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:05.117729 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827705d-137f-4631-bc82-e07f99ad086b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:05.123077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948740b5-1864-4921-92d7-0eb1b61734f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:05.123747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948740b5-1864-4921-92d7-0eb1b61734f0 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.124026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948740b5-1864-4921-92d7-0eb1b61734f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.124299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948740b5-1864-4921-92d7-0eb1b61734f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.125010 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948740b5-1864-4921-92d7-0eb1b61734f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:05.127855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948740b5-1864-4921-92d7-0eb1b61734f0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:05.161812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 962/1909] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:05 2022] POST /identity/v3/projects => generated 368 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:05.161812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70491664-95cb-4384-a569-6e1ef9e94998 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.161812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70491664-95cb-4384-a569-6e1ef9e94998 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.161812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70491664-95cb-4384-a569-6e1ef9e94998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.174329 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8946e56-639c-43d7-ae6e-bcff0d303fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:05.175177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946e56-639c-43d7-ae6e-bcff0d303fad service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.175631 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946e56-639c-43d7-ae6e-bcff0d303fad service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.176010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946e56-639c-43d7-ae6e-bcff0d303fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.188361 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8946e56-639c-43d7-ae6e-bcff0d303fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:05.190317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8946e56-639c-43d7-ae6e-bcff0d303fad service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:05.194404 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-70491664-95cb-4384-a569-6e1ef9e94998 None None] MFA Rules not processed for user `2bb79e88ad6440b0987ee396c89fed9c`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:05.195719 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-70491664-95cb-4384-a569-6e1ef9e94998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:05.203943 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 948/1910] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:05.205245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8946e56-639c-43d7-ae6e-bcff0d303fad service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.216599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8946e56-639c-43d7-ae6e-bcff0d303fad service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:05.291270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161c323-0347-4500-be94-96b7b3e6e70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:05.292065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161c323-0347-4500-be94-96b7b3e6e70e admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.292522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161c323-0347-4500-be94-96b7b3e6e70e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.292890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161c323-0347-4500-be94-96b7b3e6e70e admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.294311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161c323-0347-4500-be94-96b7b3e6e70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:05.299203 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161c323-0347-4500-be94-96b7b3e6e70e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:05.332844 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 949/1911] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:05 2022] POST /identity/v3/users => generated 285 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:05.334124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161c323-0347-4500-be94-96b7b3e6e70e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.342590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 963/1912] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:05.351091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161c323-0347-4500-be94-96b7b3e6e70e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:05.361435 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eea6b2-cae5-4066-a583-e6967e0009e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:05.361534 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea6b2-cae5-4066-a583-e6967e0009e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.361763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea6b2-cae5-4066-a583-e6967e0009e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.362035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea6b2-cae5-4066-a583-e6967e0009e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.362835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eea6b2-cae5-4066-a583-e6967e0009e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:05.364578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eea6b2-cae5-4066-a583-e6967e0009e8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:05.367632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70491664-95cb-4384-a569-6e1ef9e94998 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.371207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-70491664-95cb-4384-a569-6e1ef9e94998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:05.379273 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 950/1913] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:05 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:05.380193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eea6b2-cae5-4066-a583-e6967e0009e8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.396755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eea6b2-cae5-4066-a583-e6967e0009e8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:05.405131 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b346c54-79cc-4933-b7f6-59a576047058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:05.405799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346c54-79cc-4933-b7f6-59a576047058 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.406080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346c54-79cc-4933-b7f6-59a576047058 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.406385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346c54-79cc-4933-b7f6-59a576047058 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.407166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b346c54-79cc-4933-b7f6-59a576047058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:05.408845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b346c54-79cc-4933-b7f6-59a576047058 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:05.430725 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 951/1914] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:05 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:05.433246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b346c54-79cc-4933-b7f6-59a576047058 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.453013 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b346c54-79cc-4933-b7f6-59a576047058 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:05.478404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542ee37-2d9f-40d4-866d-16da18987afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:05.485992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70491664-95cb-4384-a569-6e1ef9e94998 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:05.486535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542ee37-2d9f-40d4-866d-16da18987afd admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.486870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542ee37-2d9f-40d4-866d-16da18987afd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.487144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542ee37-2d9f-40d4-866d-16da18987afd admin admin] PATH_INFO: `/v3/projects/c93fd876a731455387311320b8658acb/users/5b708277217d415ba2e8d98f40155634/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.492707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcba9-5a98-46c7-b1a1-725234ddfd44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:05.494794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcba9-5a98-46c7-b1a1-725234ddfd44 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.495361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcba9-5a98-46c7-b1a1-725234ddfd44 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.495815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcba9-5a98-46c7-b1a1-725234ddfd44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.510336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fcba9-5a98-46c7-b1a1-725234ddfd44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:05.515361 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fcba9-5a98-46c7-b1a1-725234ddfd44 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:05.516531 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542ee37-2d9f-40d4-866d-16da18987afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93fd876a731455387311320b8658acb, user_id=5b708277217d415ba2e8d98f40155634, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:05.519865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542ee37-2d9f-40d4-866d-16da18987afd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:05.539801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 952/1915] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:05 2022] PUT /identity/v3/projects/c93fd876a731455387311320b8658acb/users/5b708277217d415ba2e8d98f40155634/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:05.546949 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 964/1916] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:05.555217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76b5c-11f8-4e64-bd68-c6a9251c3d62 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.555506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76b5c-11f8-4e64-bd68-c6a9251c3d62 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.555787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76b5c-11f8-4e64-bd68-c6a9251c3d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.593120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-efd76b5c-11f8-4e64-bd68-c6a9251c3d62 None None] MFA Rules not processed for user `5b708277217d415ba2e8d98f40155634`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:05.594616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-efd76b5c-11f8-4e64-bd68-c6a9251c3d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:05.711160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcba9-5a98-46c7-b1a1-725234ddfd44 service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.713464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-923fcba9-5a98-46c7-b1a1-725234ddfd44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:05.728628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcba9-5a98-46c7-b1a1-725234ddfd44 service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:05.739270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 953/1917] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:05.740309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76b5c-11f8-4e64-bd68-c6a9251c3d62 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.792067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bbde4-ceaa-4ad1-a6c7-be3a18bae0f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:05.792733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bbde4-ceaa-4ad1-a6c7-be3a18bae0f2 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.793012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bbde4-ceaa-4ad1-a6c7-be3a18bae0f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.793286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bbde4-ceaa-4ad1-a6c7-be3a18bae0f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.795257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f51bbde4-ceaa-4ad1-a6c7-be3a18bae0f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:05.821809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76b5c-11f8-4e64-bd68-c6a9251c3d62 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:05.827179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b206479-183e-4e2a-aa31-6c4ee9cd1079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:05.828647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b206479-183e-4e2a-aa31-6c4ee9cd1079 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:05.828785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b206479-183e-4e2a-aa31-6c4ee9cd1079 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:05.829015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b206479-183e-4e2a-aa31-6c4ee9cd1079 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:05.829795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b206479-183e-4e2a-aa31-6c4ee9cd1079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:05.832307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b206479-183e-4e2a-aa31-6c4ee9cd1079 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:05.868761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 954/1918] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:05 2022] POST /identity/v3/projects => generated 368 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:05.868761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b206479-183e-4e2a-aa31-6c4ee9cd1079 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.872064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9b206479-183e-4e2a-aa31-6c4ee9cd1079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:05.898308 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bbde4-ceaa-4ad1-a6c7-be3a18bae0f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:05.902109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bbde4-ceaa-4ad1-a6c7-be3a18bae0f2 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:05.925335 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 965/1919] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:51:05.926990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bbde4-ceaa-4ad1-a6c7-be3a18bae0f2 service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:05.965026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bbde4-ceaa-4ad1-a6c7-be3a18bae0f2 service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:06.000799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b206479-183e-4e2a-aa31-6c4ee9cd1079 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:06.013011 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:06.013765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.014106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.014730 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] PATH_INFO: `/v3/projects/41e09c2993af4866bca8ddeaa841d9f4` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.015704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e09c2993af4866bca8ddeaa841d9f4)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:06.017925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:06.083111 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ebc87-2ab6-427c-8476-957c053d9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:06.084181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ebc87-2ab6-427c-8476-957c053d9c2f admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.084902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ebc87-2ab6-427c-8476-957c053d9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.086079 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ebc87-2ab6-427c-8476-957c053d9c2f admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.086966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ebc87-2ab6-427c-8476-957c053d9c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:06.090412 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ebc87-2ab6-427c-8476-957c053d9c2f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:06.095422 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e09c2993af4866bca8ddeaa841d9f4', 'request_id': 'req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.107704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e09c2993af4866bca8ddeaa841d9f4', 'request_id': 'req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.115225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e09c2993af4866bca8ddeaa841d9f4', 'request_id': 'req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.117083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 966/1920] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:05 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:06.122001 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ebc87-2ab6-427c-8476-957c053d9c2f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:06.134607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ebc87-2ab6-427c-8476-957c053d9c2f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:06.137515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] The token cache is being invalidate because project 41e09c2993af4866bca8ddeaa841d9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:06.137864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.140639 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.144317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 955/1921] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:05 2022] DELETE /identity/v3/projects/41e09c2993af4866bca8ddeaa841d9f4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:06.148951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:06.150794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:06.216536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa97b-2081-48d0-88d8-50f2c5c49523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:06.217505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa97b-2081-48d0-88d8-50f2c5c49523 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.218091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa97b-2081-48d0-88d8-50f2c5c49523 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.218371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa97b-2081-48d0-88d8-50f2c5c49523 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.219411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa97b-2081-48d0-88d8-50f2c5c49523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:06.221243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa97b-2081-48d0-88d8-50f2c5c49523 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:06.232966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 967/1922] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:06 2022] GET /identity/v3/roles => generated 1427 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:51:06.235496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfc377-d892-4a3d-a69e-1dd8eb2f30d3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:06.236860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa97b-2081-48d0-88d8-50f2c5c49523 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:06.238899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9fbaa97b-2081-48d0-88d8-50f2c5c49523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:06.241090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:06.242990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.243277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.243675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] PATH_INFO: `/v3/users/285d889ebff54ea79fb4769381dce1fc` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.244929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285d889ebff54ea79fb4769381dce1fc)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:06.246938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:06.252864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa97b-2081-48d0-88d8-50f2c5c49523 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:06.258804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f94a8d-6598-48de-8b80-89ae4c154581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:06.259696 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f94a8d-6598-48de-8b80-89ae4c154581 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.259973 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f94a8d-6598-48de-8b80-89ae4c154581 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.260246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f94a8d-6598-48de-8b80-89ae4c154581 admin admin] PATH_INFO: `/v3/projects/48e172b53c5b4a54b9287988af9b4e89/users/02508953a138422e8b576e5c34b2519b/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.275078 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f94a8d-6598-48de-8b80-89ae4c154581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e172b53c5b4a54b9287988af9b4e89, user_id=02508953a138422e8b576e5c34b2519b, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:06.277784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f94a8d-6598-48de-8b80-89ae4c154581 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:06.290795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 968/1923] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:06 2022] PUT /identity/v3/projects/48e172b53c5b4a54b9287988af9b4e89/users/02508953a138422e8b576e5c34b2519b/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:51:06.294596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f94a8d-6598-48de-8b80-89ae4c154581 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:06.295159 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285d889ebff54ea79fb4769381dce1fc'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.302795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285d889ebff54ea79fb4769381dce1fc'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.310637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285d889ebff54ea79fb4769381dce1fc'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.323209 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285d889ebff54ea79fb4769381dce1fc'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.323887 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285d889ebff54ea79fb4769381dce1fc'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.330311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 956/1924] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:06 2022] DELETE /identity/v3/users/285d889ebff54ea79fb4769381dce1fc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:51:06.356750 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f94a8d-6598-48de-8b80-89ae4c154581 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:06.419911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460b1f8-6ef9-4232-b5fb-b44cbd09984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:06.420576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460b1f8-6ef9-4232-b5fb-b44cbd09984d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.420873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460b1f8-6ef9-4232-b5fb-b44cbd09984d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.421125 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460b1f8-6ef9-4232-b5fb-b44cbd09984d admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.421889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460b1f8-6ef9-4232-b5fb-b44cbd09984d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:06.423677 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460b1f8-6ef9-4232-b5fb-b44cbd09984d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:06.439503 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 969/1925] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:06 2022] GET /identity/v3/roles => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:06.441042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:06.446380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:06.476630 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339620-feb2-4152-a78d-60ca83180093 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:06.484387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7807f8-ce4a-4b6f-a799-0ec076ac3dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:06.485416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7807f8-ce4a-4b6f-a799-0ec076ac3dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.485812 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7807f8-ce4a-4b6f-a799-0ec076ac3dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.486214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7807f8-ce4a-4b6f-a799-0ec076ac3dc5 admin admin] PATH_INFO: `/v3/projects/48e172b53c5b4a54b9287988af9b4e89/users/02508953a138422e8b576e5c34b2519b/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.488509 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7807f8-ce4a-4b6f-a799-0ec076ac3dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e172b53c5b4a54b9287988af9b4e89, user_id=02508953a138422e8b576e5c34b2519b, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:06.492723 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7807f8-ce4a-4b6f-a799-0ec076ac3dc5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:06.504894 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 957/1926] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:06 2022] PUT /identity/v3/projects/48e172b53c5b4a54b9287988af9b4e89/users/02508953a138422e8b576e5c34b2519b/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:06.515911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e957cea-c4eb-4633-ad61-097c58af909d None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.516508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e957cea-c4eb-4633-ad61-097c58af909d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.517201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e957cea-c4eb-4633-ad61-097c58af909d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.553623 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-9e957cea-c4eb-4633-ad61-097c58af909d None None] MFA Rules not processed for user `02508953a138422e8b576e5c34b2519b`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:06.556119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9e957cea-c4eb-4633-ad61-097c58af909d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:06.635871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7807f8-ce4a-4b6f-a799-0ec076ac3dc5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:06.637866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1b7807f8-ce4a-4b6f-a799-0ec076ac3dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:06.642455 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 970/1927] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:06.650233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e957cea-c4eb-4633-ad61-097c58af909d None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:06.651768 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9e957cea-c4eb-4633-ad61-097c58af909d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:06.730320 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e957cea-c4eb-4633-ad61-097c58af909d None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:06.735053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ca1e-ebee-4f5c-b6f2-aa0b1c589181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:06.735983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ca1e-ebee-4f5c-b6f2-aa0b1c589181 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.736264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ca1e-ebee-4f5c-b6f2-aa0b1c589181 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.736837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ca1e-ebee-4f5c-b6f2-aa0b1c589181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.749084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151ca1e-ebee-4f5c-b6f2-aa0b1c589181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:06.750098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151ca1e-ebee-4f5c-b6f2-aa0b1c589181 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:06.753353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7807f8-ce4a-4b6f-a799-0ec076ac3dc5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:06.761470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 971/1928] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:51:06.762623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:06.763857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.764410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.764862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] PATH_INFO: `/v3/projects/413fc49f62ae45ab9faad74f469617b0` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.766978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=413fc49f62ae45ab9faad74f469617b0)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:06.769478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:06.823351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413fc49f62ae45ab9faad74f469617b0', 'request_id': 'req-1b91b32d-ca31-4b74-8297-eb5b41fef195'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.831900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413fc49f62ae45ab9faad74f469617b0', 'request_id': 'req-1b91b32d-ca31-4b74-8297-eb5b41fef195'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.838420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413fc49f62ae45ab9faad74f469617b0', 'request_id': 'req-1b91b32d-ca31-4b74-8297-eb5b41fef195'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.848520 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] The token cache is being invalidate because project 413fc49f62ae45ab9faad74f469617b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:06.848803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.849480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.851556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 958/1929] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:06 2022] DELETE /identity/v3/projects/413fc49f62ae45ab9faad74f469617b0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:06.855338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ca1e-ebee-4f5c-b6f2-aa0b1c589181 service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:06.858082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:06.859457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:06.865376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ca1e-ebee-4f5c-b6f2-aa0b1c589181 service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:06.920221 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91b32d-ca31-4b74-8297-eb5b41fef195 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:06.923845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4c5d2-7ba5-4fdd-92ef-0e55b6440eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:06.924134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7144b2-c99c-4265-8b48-211b1dffedad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:06.924484 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4c5d2-7ba5-4fdd-92ef-0e55b6440eaa service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.924765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4c5d2-7ba5-4fdd-92ef-0e55b6440eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.925041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4c5d2-7ba5-4fdd-92ef-0e55b6440eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.925137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7144b2-c99c-4265-8b48-211b1dffedad admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:06.925322 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7144b2-c99c-4265-8b48-211b1dffedad admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:06.925599 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7144b2-c99c-4265-8b48-211b1dffedad admin admin] PATH_INFO: `/v3/users/e1ca09141b904b8d92792f12da3e9083` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:06.926918 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-30f4c5d2-7ba5-4fdd-92ef-0e55b6440eaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:06.927108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7144b2-c99c-4265-8b48-211b1dffedad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ca09141b904b8d92792f12da3e9083)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:06.929158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7144b2-c99c-4265-8b48-211b1dffedad admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:06.973572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4c7144b2-c99c-4265-8b48-211b1dffedad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ca09141b904b8d92792f12da3e9083'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.985281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4c5d2-7ba5-4fdd-92ef-0e55b6440eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:06.986883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4c5d2-7ba5-4fdd-92ef-0e55b6440eaa service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:06.988212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4c7144b2-c99c-4265-8b48-211b1dffedad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ca09141b904b8d92792f12da3e9083'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.988946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4c7144b2-c99c-4265-8b48-211b1dffedad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ca09141b904b8d92792f12da3e9083'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.989571 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4c7144b2-c99c-4265-8b48-211b1dffedad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ca09141b904b8d92792f12da3e9083'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:06.997347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 959/1930] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:51:06.998383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4c7144b2-c99c-4265-8b48-211b1dffedad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ca09141b904b8d92792f12da3e9083'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:07.012278 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 972/1931] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:06 2022] DELETE /identity/v3/users/e1ca09141b904b8d92792f12da3e9083 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:07.370947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4c5d2-7ba5-4fdd-92ef-0e55b6440eaa service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:07.372170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-30f4c5d2-7ba5-4fdd-92ef-0e55b6440eaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:07.394728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4c5d2-7ba5-4fdd-92ef-0e55b6440eaa service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:07.456586 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:07.457374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:07.457655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:07.457935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] PATH_INFO: `/v3/projects/92c4149635ee404dba8eca38d8224d0b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:07.459144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c4149635ee404dba8eca38d8224d0b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:07.461072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:07.508285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c4149635ee404dba8eca38d8224d0b', 'request_id': 'req-a4bef9f5-bc70-4a92-b59d-58f4dc493725'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:07.515328 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c4149635ee404dba8eca38d8224d0b', 'request_id': 'req-a4bef9f5-bc70-4a92-b59d-58f4dc493725'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:07.521388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c4149635ee404dba8eca38d8224d0b', 'request_id': 'req-a4bef9f5-bc70-4a92-b59d-58f4dc493725'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:07.531277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] The token cache is being invalidate because project 92c4149635ee404dba8eca38d8224d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:07.531565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:07.532187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a4bef9f5-bc70-4a92-b59d-58f4dc493725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:07.533784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 960/1932] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:07 2022] DELETE /identity/v3/projects/92c4149635ee404dba8eca38d8224d0b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:07.540241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e4973-4d68-42fa-bd51-b7ba035c4010 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:07.540608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e4973-4d68-42fa-bd51-b7ba035c4010 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:07.540890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e4973-4d68-42fa-bd51-b7ba035c4010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:07.559471 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f71e4973-4d68-42fa-bd51-b7ba035c4010 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:07.560647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f71e4973-4d68-42fa-bd51-b7ba035c4010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:07.627274 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 973/1933] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:07.628979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8409-1504-49c8-8180-956397153fa0 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:07.629274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8409-1504-49c8-8180-956397153fa0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:07.629559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8409-1504-49c8-8180-956397153fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:07.648746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-dc7d8409-1504-49c8-8180-956397153fa0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:07.649956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dc7d8409-1504-49c8-8180-956397153fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:07.657884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 961/1934] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:07.662510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e4973-4d68-42fa-bd51-b7ba035c4010 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:07.672891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e4973-4d68-42fa-bd51-b7ba035c4010 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:07.677669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f14d2-a77d-48b5-bd91-4570f3746fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:07.678267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f14d2-a77d-48b5-bd91-4570f3746fdb admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:07.678553 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f14d2-a77d-48b5-bd91-4570f3746fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:07.678899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f14d2-a77d-48b5-bd91-4570f3746fdb admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:07.679669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f14d2-a77d-48b5-bd91-4570f3746fdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:07.679972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f14d2-a77d-48b5-bd91-4570f3746fdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:07.681613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f14d2-a77d-48b5-bd91-4570f3746fdb admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:07.694493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 974/1935] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:51:07.698875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d8409-1504-49c8-8180-956397153fa0 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:07.707799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d8409-1504-49c8-8180-956397153fa0 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:07.712997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac3da4-67a2-437c-8ba8-754961892739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:07.713641 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3da4-67a2-437c-8ba8-754961892739 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:07.713921 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3da4-67a2-437c-8ba8-754961892739 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:07.714193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3da4-67a2-437c-8ba8-754961892739 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:07.714950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac3da4-67a2-437c-8ba8-754961892739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:07.716825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac3da4-67a2-437c-8ba8-754961892739 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:07.742813 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 962/1936] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:07 2022] POST /identity/v3/projects => generated 374 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:07.747107 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f14d2-a77d-48b5-bd91-4570f3746fdb admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:07.758246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f14d2-a77d-48b5-bd91-4570f3746fdb admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:07.837563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0bc9f-88cb-4bfe-8761-b721887f4a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:07.838222 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0bc9f-88cb-4bfe-8761-b721887f4a8b admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:07.838502 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0bc9f-88cb-4bfe-8761-b721887f4a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:07.838800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0bc9f-88cb-4bfe-8761-b721887f4a8b admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:07.839515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0bc9f-88cb-4bfe-8761-b721887f4a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:07.841402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0bc9f-88cb-4bfe-8761-b721887f4a8b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:07.861477 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 975/1937] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:07 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:07.865710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac3da4-67a2-437c-8ba8-754961892739 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:07.876310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac3da4-67a2-437c-8ba8-754961892739 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:07.881015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c481e-72db-4629-9218-3d2457df0f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:07.881763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c481e-72db-4629-9218-3d2457df0f9a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:07.882075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c481e-72db-4629-9218-3d2457df0f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:07.882788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c481e-72db-4629-9218-3d2457df0f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:07.883281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c481e-72db-4629-9218-3d2457df0f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:07.884879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c481e-72db-4629-9218-3d2457df0f9a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:07.895860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 963/1938] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:07 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:07.901415 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0bc9f-88cb-4bfe-8761-b721887f4a8b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:07.912765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0bc9f-88cb-4bfe-8761-b721887f4a8b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:07.919307 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171f8f-1635-4f27-8f5a-69d396ff8d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:07.920305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171f8f-1635-4f27-8f5a-69d396ff8d10 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:07.920638 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171f8f-1635-4f27-8f5a-69d396ff8d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:07.921136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171f8f-1635-4f27-8f5a-69d396ff8d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:07.921868 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25171f8f-1635-4f27-8f5a-69d396ff8d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:07.923821 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25171f8f-1635-4f27-8f5a-69d396ff8d10 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:07.937714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 976/1939] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:07 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:07.938903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c481e-72db-4629-9218-3d2457df0f9a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:07.948863 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c481e-72db-4629-9218-3d2457df0f9a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:07.953742 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad0568-a7c6-42dd-b5f1-13dad4e93a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:07.954613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad0568-a7c6-42dd-b5f1-13dad4e93a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:07.954931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad0568-a7c6-42dd-b5f1-13dad4e93a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:07.955198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad0568-a7c6-42dd-b5f1-13dad4e93a31 admin admin] PATH_INFO: `/v3/projects/e5e86d82e0524fd380e44df98739cfa3/users/54f058a8f1014fde9d4ec742e8174d00/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:07.973072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad0568-a7c6-42dd-b5f1-13dad4e93a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e86d82e0524fd380e44df98739cfa3, user_id=54f058a8f1014fde9d4ec742e8174d00, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:07.977132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad0568-a7c6-42dd-b5f1-13dad4e93a31 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:07.989427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 964/1940] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:07 2022] PUT /identity/v3/projects/e5e86d82e0524fd380e44df98739cfa3/users/54f058a8f1014fde9d4ec742e8174d00/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:07.994897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927efa99-32ff-49d7-8cda-f51350cac258 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:07.995362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927efa99-32ff-49d7-8cda-f51350cac258 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:07.995459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927efa99-32ff-49d7-8cda-f51350cac258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:08.013425 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-927efa99-32ff-49d7-8cda-f51350cac258 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:08.014630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-927efa99-32ff-49d7-8cda-f51350cac258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:08.074052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 977/1941] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:08.085993 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad0568-a7c6-42dd-b5f1-13dad4e93a31 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:08.088183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-afad0568-a7c6-42dd-b5f1-13dad4e93a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:08.152005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad0568-a7c6-42dd-b5f1-13dad4e93a31 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:08.156282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7cfb1-c6db-4de6-b083-f953b7e1d9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:08.156932 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7cfb1-c6db-4de6-b083-f953b7e1d9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:08.157229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7cfb1-c6db-4de6-b083-f953b7e1d9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:08.157488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7cfb1-c6db-4de6-b083-f953b7e1d9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:08.168314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7cfb1-c6db-4de6-b083-f953b7e1d9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:08.169908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7cfb1-c6db-4de6-b083-f953b7e1d9d6 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:08.180239 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 965/1942] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:09.354954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118634f-b5ec-4627-8dfe-b5f2ca7aad31 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:09.355788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118634f-b5ec-4627-8dfe-b5f2ca7aad31 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:09.356068 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118634f-b5ec-4627-8dfe-b5f2ca7aad31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:09.386529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-8118634f-b5ec-4627-8dfe-b5f2ca7aad31 None None] MFA Rules not processed for user `54f058a8f1014fde9d4ec742e8174d00`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:09.387856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8118634f-b5ec-4627-8dfe-b5f2ca7aad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:09.460459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 978/1943] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:09.472229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7cfb1-c6db-4de6-b083-f953b7e1d9d6 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:09.474140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0dc7cfb1-c6db-4de6-b083-f953b7e1d9d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:09.533946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7cfb1-c6db-4de6-b083-f953b7e1d9d6 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:09.537517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9c5a5-79f8-45e5-b7a5-03bdb44cd2f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:09.538841 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9c5a5-79f8-45e5-b7a5-03bdb44cd2f6 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:09.539121 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9c5a5-79f8-45e5-b7a5-03bdb44cd2f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:09.539387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9c5a5-79f8-45e5-b7a5-03bdb44cd2f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:09.548101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9c5a5-79f8-45e5-b7a5-03bdb44cd2f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:09.549583 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9c5a5-79f8-45e5-b7a5-03bdb44cd2f6 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:09.562862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 966/1944] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:10.902308 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c083ef-0037-4867-ab8f-3a1ddd62d0c7 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:10.902853 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c083ef-0037-4867-ab8f-3a1ddd62d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:10.902998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c083ef-0037-4867-ab8f-3a1ddd62d0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:10.920654 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b3c083ef-0037-4867-ab8f-3a1ddd62d0c7 None None] MFA Rules not processed for user `54f058a8f1014fde9d4ec742e8174d00`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:10.921924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b3c083ef-0037-4867-ab8f-3a1ddd62d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:10.929385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 979/1945] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:12.099501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9c5a5-79f8-45e5-b7a5-03bdb44cd2f6 service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:12.101840 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-fab9c5a5-79f8-45e5-b7a5-03bdb44cd2f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:12.129949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9c5a5-79f8-45e5-b7a5-03bdb44cd2f6 service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:12.138346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:12.139549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:12.140053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:12.140620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] PATH_INFO: `/v3/users/5b708277217d415ba2e8d98f40155634` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:12.142707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b708277217d415ba2e8d98f40155634)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:12.144987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:12.207070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b708277217d415ba2e8d98f40155634'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:12.217197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b708277217d415ba2e8d98f40155634'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:12.226441 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b708277217d415ba2e8d98f40155634'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:12.246699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b708277217d415ba2e8d98f40155634'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:12.247655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b708277217d415ba2e8d98f40155634'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:12.258686 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 967/1946] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:12 2022] DELETE /identity/v3/users/5b708277217d415ba2e8d98f40155634 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:12.263224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeb0e2-ff41-4c17-880b-e7cb397990f7 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:12.263711 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeb0e2-ff41-4c17-880b-e7cb397990f7 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:12.263805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeb0e2-ff41-4c17-880b-e7cb397990f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:12.297082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-1fdeb0e2-ff41-4c17-880b-e7cb397990f7 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:12.298682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1fdeb0e2-ff41-4c17-880b-e7cb397990f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:12.379303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 980/1947] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:12.389433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:12.391047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:12.477885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca2c9a-82e4-49ad-aa45-69fde64684ac admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:12.481965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e51b3f-f804-4021-8d51-5c68c2086c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:12.483048 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51b3f-f804-4021-8d51-5c68c2086c76 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:12.483336 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51b3f-f804-4021-8d51-5c68c2086c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:12.483914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51b3f-f804-4021-8d51-5c68c2086c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:12.498916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e51b3f-f804-4021-8d51-5c68c2086c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:12.500897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e51b3f-f804-4021-8d51-5c68c2086c76 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:12.513873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 968/1948] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:12.926081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeb0e2-ff41-4c17-880b-e7cb397990f7 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:12.930223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1fdeb0e2-ff41-4c17-880b-e7cb397990f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:12.962276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeb0e2-ff41-4c17-880b-e7cb397990f7 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:12.977487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:12.978624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:12.980704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:12.981191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] PATH_INFO: `/v3/projects/c93fd876a731455387311320b8658acb` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:12.986426 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93fd876a731455387311320b8658acb)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:12.989798 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:13.077463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93fd876a731455387311320b8658acb', 'request_id': 'req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:13.085605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93fd876a731455387311320b8658acb', 'request_id': 'req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:13.098874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93fd876a731455387311320b8658acb', 'request_id': 'req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:13.116734 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] The token cache is being invalidate because project c93fd876a731455387311320b8658acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:13.117074 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:13.118270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:13.119885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 981/1949] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:12 2022] DELETE /identity/v3/projects/c93fd876a731455387311320b8658acb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:13.123533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e51b3f-f804-4021-8d51-5c68c2086c76 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:13.134934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e51b3f-f804-4021-8d51-5c68c2086c76 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:13.226076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20198d-4a83-485e-9eda-970514031122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:13.227349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20198d-4a83-485e-9eda-970514031122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:13.227692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20198d-4a83-485e-9eda-970514031122 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:13.228149 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20198d-4a83-485e-9eda-970514031122 admin admin] PATH_INFO: `/v3/users/02508953a138422e8b576e5c34b2519b` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:13.232774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20198d-4a83-485e-9eda-970514031122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02508953a138422e8b576e5c34b2519b)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:13.235763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20198d-4a83-485e-9eda-970514031122 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:13.333691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4f20198d-4a83-485e-9eda-970514031122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02508953a138422e8b576e5c34b2519b'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:13.345214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4f20198d-4a83-485e-9eda-970514031122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02508953a138422e8b576e5c34b2519b'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:13.353102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4f20198d-4a83-485e-9eda-970514031122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02508953a138422e8b576e5c34b2519b'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:13.370338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4f20198d-4a83-485e-9eda-970514031122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02508953a138422e8b576e5c34b2519b'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:13.371116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4f20198d-4a83-485e-9eda-970514031122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02508953a138422e8b576e5c34b2519b'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:13.377903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 969/1950] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:13 2022] DELETE /identity/v3/users/02508953a138422e8b576e5c34b2519b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:14.403230 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:14.405917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:14.434147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b44ecd-b8ca-4bd7-ab2f-2c63fb30c428 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:14.529322 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:14.531034 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:14.531329 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:14.531615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] PATH_INFO: `/v3/projects/48e172b53c5b4a54b9287988af9b4e89` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:14.533179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e172b53c5b4a54b9287988af9b4e89)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:14.536341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:14.621738 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e172b53c5b4a54b9287988af9b4e89', 'request_id': 'req-c036ab5b-7629-42ec-91b5-53b2816c6127'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:14.629326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e172b53c5b4a54b9287988af9b4e89', 'request_id': 'req-c036ab5b-7629-42ec-91b5-53b2816c6127'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:14.640456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e172b53c5b4a54b9287988af9b4e89', 'request_id': 'req-c036ab5b-7629-42ec-91b5-53b2816c6127'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:14.654888 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] The token cache is being invalidate because project 48e172b53c5b4a54b9287988af9b4e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:14.655483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:14.656340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c036ab5b-7629-42ec-91b5-53b2816c6127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:14.659110 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 982/1951] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:14 2022] DELETE /identity/v3/projects/48e172b53c5b4a54b9287988af9b4e89 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:14.667207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b23660-851e-4ffd-8ea9-578ed7effa75 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:14.670248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b23660-851e-4ffd-8ea9-578ed7effa75 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:14.680718 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b23660-851e-4ffd-8ea9-578ed7effa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:14.726980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e2b23660-851e-4ffd-8ea9-578ed7effa75 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:14.730366 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e2b23660-851e-4ffd-8ea9-578ed7effa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:14.813265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 970/1952] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:14.823464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6efb4-9858-4c07-b21b-f045e2f209e3 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:14.824134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6efb4-9858-4c07-b21b-f045e2f209e3 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:14.824628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6efb4-9858-4c07-b21b-f045e2f209e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:14.871660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-83e6efb4-9858-4c07-b21b-f045e2f209e3 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:14.876083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-83e6efb4-9858-4c07-b21b-f045e2f209e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:14.887398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 983/1953] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:14.892147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b23660-851e-4ffd-8ea9-578ed7effa75 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:14.903501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b23660-851e-4ffd-8ea9-578ed7effa75 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:14.909311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8448b5-95d5-4866-b673-51503b1f655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:14.909978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8448b5-95d5-4866-b673-51503b1f655e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:14.910264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8448b5-95d5-4866-b673-51503b1f655e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:14.910545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8448b5-95d5-4866-b673-51503b1f655e admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:14.911319 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8448b5-95d5-4866-b673-51503b1f655e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:14.911632 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8448b5-95d5-4866-b673-51503b1f655e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:14.913860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8448b5-95d5-4866-b673-51503b1f655e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:14.927587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 971/1954] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:51:14.932406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6efb4-9858-4c07-b21b-f045e2f209e3 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:14.942807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6efb4-9858-4c07-b21b-f045e2f209e3 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:14.951801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721617b-850c-4782-9b78-31ed9cf7d1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:14.952712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721617b-850c-4782-9b78-31ed9cf7d1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:14.953254 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721617b-850c-4782-9b78-31ed9cf7d1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:14.953544 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721617b-850c-4782-9b78-31ed9cf7d1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:14.954295 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721617b-850c-4782-9b78-31ed9cf7d1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:14.956634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721617b-850c-4782-9b78-31ed9cf7d1e6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:14.990275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 984/1955] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:14 2022] POST /identity/v3/projects => generated 384 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:14.992085 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8448b5-95d5-4866-b673-51503b1f655e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:15.002004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8448b5-95d5-4866-b673-51503b1f655e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:15.064805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b75dbe-34f2-48e8-8d6b-06a35aabf7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:15.065858 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b75dbe-34f2-48e8-8d6b-06a35aabf7dc admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.066140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b75dbe-34f2-48e8-8d6b-06a35aabf7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.066413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b75dbe-34f2-48e8-8d6b-06a35aabf7dc admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.067318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b75dbe-34f2-48e8-8d6b-06a35aabf7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:15.069438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b75dbe-34f2-48e8-8d6b-06a35aabf7dc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:15.097837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 972/1956] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:14 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:15.102343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721617b-850c-4782-9b78-31ed9cf7d1e6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:15.124932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721617b-850c-4782-9b78-31ed9cf7d1e6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:15.130953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb14ab-023f-424d-84bb-debd38a9f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:15.132050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb14ab-023f-424d-84bb-debd38a9f26c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.138095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb14ab-023f-424d-84bb-debd38a9f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.138911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb14ab-023f-424d-84bb-debd38a9f26c admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.140085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb14ab-023f-424d-84bb-debd38a9f26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:15.142205 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb14ab-023f-424d-84bb-debd38a9f26c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:15.179664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 985/1957] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:15 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:51:15.179938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b75dbe-34f2-48e8-8d6b-06a35aabf7dc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:15.189837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b75dbe-34f2-48e8-8d6b-06a35aabf7dc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:15.195773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abc02b-1e11-4460-b465-077b5dc88a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:15.196647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abc02b-1e11-4460-b465-077b5dc88a50 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.196986 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abc02b-1e11-4460-b465-077b5dc88a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.197407 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abc02b-1e11-4460-b465-077b5dc88a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.198269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abc02b-1e11-4460-b465-077b5dc88a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:15.200018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abc02b-1e11-4460-b465-077b5dc88a50 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:15.211291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 973/1958] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:15 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:15.215547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb14ab-023f-424d-84bb-debd38a9f26c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:15.226809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb14ab-023f-424d-84bb-debd38a9f26c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:15.233826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54613846-0808-4421-ae5a-478be9f0c9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:15.234859 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54613846-0808-4421-ae5a-478be9f0c9db admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.235844 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54613846-0808-4421-ae5a-478be9f0c9db admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.236191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54613846-0808-4421-ae5a-478be9f0c9db admin admin] PATH_INFO: `/v3/projects/e153afc7b4ed4f84b82df2603b17af52/users/e46e652460724b298e9c60d6822f6880/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.253751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54613846-0808-4421-ae5a-478be9f0c9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e153afc7b4ed4f84b82df2603b17af52, user_id=e46e652460724b298e9c60d6822f6880, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:15.257109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54613846-0808-4421-ae5a-478be9f0c9db admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:15.271859 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 986/1959] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:15 2022] PUT /identity/v3/projects/e153afc7b4ed4f84b82df2603b17af52/users/e46e652460724b298e9c60d6822f6880/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:15.282790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc294bf-a3ca-48d1-96c3-9550994b79d4 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.283095 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc294bf-a3ca-48d1-96c3-9550994b79d4 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.283383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc294bf-a3ca-48d1-96c3-9550994b79d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.316275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-cfc294bf-a3ca-48d1-96c3-9550994b79d4 None None] MFA Rules not processed for user `e46e652460724b298e9c60d6822f6880`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:15.317508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-cfc294bf-a3ca-48d1-96c3-9550994b79d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:15.399618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 974/1960] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:15.404238 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54613846-0808-4421-ae5a-478be9f0c9db admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:15.470422 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54613846-0808-4421-ae5a-478be9f0c9db admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:15.475375 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2df916-89b6-4710-97c9-d2f53939b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:15.476046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2df916-89b6-4710-97c9-d2f53939b850 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.476316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2df916-89b6-4710-97c9-d2f53939b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.476594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2df916-89b6-4710-97c9-d2f53939b850 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.477318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2df916-89b6-4710-97c9-d2f53939b850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:15.479243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2df916-89b6-4710-97c9-d2f53939b850 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:15.510597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 987/1961] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:15 2022] POST /identity/v3/projects => generated 382 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:15.512465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc294bf-a3ca-48d1-96c3-9550994b79d4 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:15.523549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc294bf-a3ca-48d1-96c3-9550994b79d4 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:15.579907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4100f3-010e-4fbf-b96a-02fbeadb0324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:15.580492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4100f3-010e-4fbf-b96a-02fbeadb0324 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.580775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4100f3-010e-4fbf-b96a-02fbeadb0324 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.581055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4100f3-010e-4fbf-b96a-02fbeadb0324 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.581778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4100f3-010e-4fbf-b96a-02fbeadb0324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:15.583751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4100f3-010e-4fbf-b96a-02fbeadb0324 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:15.608206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 975/1962] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:15 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:15.609523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2df916-89b6-4710-97c9-d2f53939b850 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:15.620717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2df916-89b6-4710-97c9-d2f53939b850 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:15.625726 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792681d-12a9-413a-ab59-aef46d16e534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:15.626390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792681d-12a9-413a-ab59-aef46d16e534 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.626672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792681d-12a9-413a-ab59-aef46d16e534 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.627152 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792681d-12a9-413a-ab59-aef46d16e534 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.627909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792681d-12a9-413a-ab59-aef46d16e534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:15.629508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792681d-12a9-413a-ab59-aef46d16e534 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:15.641512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 988/1963] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:15 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:15.647086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4100f3-010e-4fbf-b96a-02fbeadb0324 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:15.659654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4100f3-010e-4fbf-b96a-02fbeadb0324 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:15.664890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32014d-2ca3-4d0e-96fa-7811a179735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:15.665768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32014d-2ca3-4d0e-96fa-7811a179735d admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.666048 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32014d-2ca3-4d0e-96fa-7811a179735d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.666324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32014d-2ca3-4d0e-96fa-7811a179735d admin admin] PATH_INFO: `/v3/projects/55456982280f4a3d80a7f30f3e0bd475/users/3d514175815d49d2ad3dde7fb7cd70e5/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.681926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32014d-2ca3-4d0e-96fa-7811a179735d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55456982280f4a3d80a7f30f3e0bd475, user_id=3d514175815d49d2ad3dde7fb7cd70e5, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:15.684617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32014d-2ca3-4d0e-96fa-7811a179735d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:15.699330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 976/1964] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:15 2022] PUT /identity/v3/projects/55456982280f4a3d80a7f30f3e0bd475/users/3d514175815d49d2ad3dde7fb7cd70e5/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:15.717719 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792681d-12a9-413a-ab59-aef46d16e534 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:15.738682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792681d-12a9-413a-ab59-aef46d16e534 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:15.800072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83723d7d-c2ad-498f-b5a9-fe93ff4c8e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:15.800748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83723d7d-c2ad-498f-b5a9-fe93ff4c8e9c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.801037 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83723d7d-c2ad-498f-b5a9-fe93ff4c8e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.801313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83723d7d-c2ad-498f-b5a9-fe93ff4c8e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.802061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83723d7d-c2ad-498f-b5a9-fe93ff4c8e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:15.804340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83723d7d-c2ad-498f-b5a9-fe93ff4c8e9c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:15.818005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 989/1965] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:15 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:15.819456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32014d-2ca3-4d0e-96fa-7811a179735d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:15.830229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32014d-2ca3-4d0e-96fa-7811a179735d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:15.835570 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e29079-932f-44a3-acff-07f2832496cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:15.836447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e29079-932f-44a3-acff-07f2832496cf admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.836729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e29079-932f-44a3-acff-07f2832496cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.837003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e29079-932f-44a3-acff-07f2832496cf admin admin] PATH_INFO: `/v3/projects/55456982280f4a3d80a7f30f3e0bd475/users/3d514175815d49d2ad3dde7fb7cd70e5/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.839322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e29079-932f-44a3-acff-07f2832496cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=55456982280f4a3d80a7f30f3e0bd475, user_id=3d514175815d49d2ad3dde7fb7cd70e5, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:15.841809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e29079-932f-44a3-acff-07f2832496cf admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:15.853255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 977/1966] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:15 2022] PUT /identity/v3/projects/55456982280f4a3d80a7f30f3e0bd475/users/3d514175815d49d2ad3dde7fb7cd70e5/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:15.863493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9349be6-0c3b-497c-b15c-987dd6f9db53 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:15.864053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9349be6-0c3b-497c-b15c-987dd6f9db53 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:15.864333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9349be6-0c3b-497c-b15c-987dd6f9db53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:15.892014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f9349be6-0c3b-497c-b15c-987dd6f9db53 None None] MFA Rules not processed for user `3d514175815d49d2ad3dde7fb7cd70e5`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:15.893228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f9349be6-0c3b-497c-b15c-987dd6f9db53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:15.970163 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 990/1967] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:15.985963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e29079-932f-44a3-acff-07f2832496cf admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:15.987854 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f7e29079-932f-44a3-acff-07f2832496cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:16.062210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e29079-932f-44a3-acff-07f2832496cf admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:16.067929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa476f2-b41a-41a7-9835-e5b381be93fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:16.072516 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa476f2-b41a-41a7-9835-e5b381be93fe service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:16.073171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa476f2-b41a-41a7-9835-e5b381be93fe service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:16.073472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa476f2-b41a-41a7-9835-e5b381be93fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:16.087260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa476f2-b41a-41a7-9835-e5b381be93fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:16.088794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa476f2-b41a-41a7-9835-e5b381be93fe service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:16.104018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 978/1968] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:16.246889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9349be6-0c3b-497c-b15c-987dd6f9db53 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:16.270606 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9349be6-0c3b-497c-b15c-987dd6f9db53 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:16.282085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19212217-c089-40a9-a8a4-10914a6fe273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:16.282999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19212217-c089-40a9-a8a4-10914a6fe273 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:16.283471 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19212217-c089-40a9-a8a4-10914a6fe273 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:16.283917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19212217-c089-40a9-a8a4-10914a6fe273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:16.376998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19212217-c089-40a9-a8a4-10914a6fe273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:16.379934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19212217-c089-40a9-a8a4-10914a6fe273 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:16.398531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 991/1969] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:16.716404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa476f2-b41a-41a7-9835-e5b381be93fe service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:16.787133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa476f2-b41a-41a7-9835-e5b381be93fe service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:16.794442 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:16.795350 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:16.795633 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:16.795905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] PATH_INFO: `/v3/users/e46e652460724b298e9c60d6822f6880` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:16.797262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46e652460724b298e9c60d6822f6880)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:16.801078 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:16.873175 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46e652460724b298e9c60d6822f6880'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:16.885147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46e652460724b298e9c60d6822f6880'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:16.892457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46e652460724b298e9c60d6822f6880'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:16.904755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46e652460724b298e9c60d6822f6880'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:16.905469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46e652460724b298e9c60d6822f6880'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:16.911355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 979/1970] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:16 2022] DELETE /identity/v3/users/e46e652460724b298e9c60d6822f6880 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:16.916703 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5c74-81c1-4581-b62f-c7b85cb9c179 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:16.917186 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5c74-81c1-4581-b62f-c7b85cb9c179 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:16.917294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5c74-81c1-4581-b62f-c7b85cb9c179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:16.935195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-2f9d5c74-81c1-4581-b62f-c7b85cb9c179 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:16.936432 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2f9d5c74-81c1-4581-b62f-c7b85cb9c179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:17.001634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 992/1971] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:17.011892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:17.014136 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:17.074793 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c57138-57c6-428a-968c-245c8c80c9b2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:17.078501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615a06d-fc24-4f62-8104-3efc9dfe470e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:17.079183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a06d-fc24-4f62-8104-3efc9dfe470e service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:17.079469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a06d-fc24-4f62-8104-3efc9dfe470e service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:17.079746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a06d-fc24-4f62-8104-3efc9dfe470e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:17.090839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615a06d-fc24-4f62-8104-3efc9dfe470e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:17.092225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615a06d-fc24-4f62-8104-3efc9dfe470e service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:17.102787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 980/1972] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:17.566653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d5c74-81c1-4581-b62f-c7b85cb9c179 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:17.568338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2f9d5c74-81c1-4581-b62f-c7b85cb9c179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:17.582342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d5c74-81c1-4581-b62f-c7b85cb9c179 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:17.588586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:17.589452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:17.589737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:17.590016 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] PATH_INFO: `/v3/projects/e153afc7b4ed4f84b82df2603b17af52` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:17.591265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e153afc7b4ed4f84b82df2603b17af52)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:17.593166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:17.644431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e153afc7b4ed4f84b82df2603b17af52', 'request_id': 'req-7f736d46-af5b-4d49-8abc-8f544d260853'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:17.650947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e153afc7b4ed4f84b82df2603b17af52', 'request_id': 'req-7f736d46-af5b-4d49-8abc-8f544d260853'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:17.661661 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e153afc7b4ed4f84b82df2603b17af52', 'request_id': 'req-7f736d46-af5b-4d49-8abc-8f544d260853'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:17.673875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] The token cache is being invalidate because project e153afc7b4ed4f84b82df2603b17af52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:17.674163 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:17.674947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:17.676658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 993/1973] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:17 2022] DELETE /identity/v3/projects/e153afc7b4ed4f84b82df2603b17af52 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:17.681345 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615a06d-fc24-4f62-8104-3efc9dfe470e service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:17.691811 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615a06d-fc24-4f62-8104-3efc9dfe470e service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:17.758694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed2c8-7bc6-4b10-9299-a349a37308eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:17.759699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed2c8-7bc6-4b10-9299-a349a37308eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:17.759982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed2c8-7bc6-4b10-9299-a349a37308eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:17.760259 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed2c8-7bc6-4b10-9299-a349a37308eb admin admin] PATH_INFO: `/v3/users/3d514175815d49d2ad3dde7fb7cd70e5` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:17.761499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ed2c8-7bc6-4b10-9299-a349a37308eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d514175815d49d2ad3dde7fb7cd70e5)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:17.763680 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ed2c8-7bc6-4b10-9299-a349a37308eb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:17.817677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4a5ed2c8-7bc6-4b10-9299-a349a37308eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d514175815d49d2ad3dde7fb7cd70e5'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:17.827598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4a5ed2c8-7bc6-4b10-9299-a349a37308eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d514175815d49d2ad3dde7fb7cd70e5'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:17.836261 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4a5ed2c8-7bc6-4b10-9299-a349a37308eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d514175815d49d2ad3dde7fb7cd70e5'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:17.863679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4a5ed2c8-7bc6-4b10-9299-a349a37308eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d514175815d49d2ad3dde7fb7cd70e5'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:17.866271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4a5ed2c8-7bc6-4b10-9299-a349a37308eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d514175815d49d2ad3dde7fb7cd70e5'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:17.878802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 981/1974] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:17 2022] DELETE /identity/v3/users/3d514175815d49d2ad3dde7fb7cd70e5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:18.249705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:18.251757 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:18.291465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f736d46-af5b-4d49-8abc-8f544d260853 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:18.354195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:18.355108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:18.355394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:18.355672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] PATH_INFO: `/v3/projects/55456982280f4a3d80a7f30f3e0bd475` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:18.356880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55456982280f4a3d80a7f30f3e0bd475)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:18.358805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:18.403750 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55456982280f4a3d80a7f30f3e0bd475', 'request_id': 'req-811c59d0-a135-4d14-9119-a6bd0da763c5'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:18.408938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55456982280f4a3d80a7f30f3e0bd475', 'request_id': 'req-811c59d0-a135-4d14-9119-a6bd0da763c5'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:18.416286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55456982280f4a3d80a7f30f3e0bd475', 'request_id': 'req-811c59d0-a135-4d14-9119-a6bd0da763c5'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:18.427122 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] The token cache is being invalidate because project 55456982280f4a3d80a7f30f3e0bd475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:18.427408 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:18.428821 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-811c59d0-a135-4d14-9119-a6bd0da763c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:18.430509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 994/1975] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:18 2022] DELETE /identity/v3/projects/55456982280f4a3d80a7f30f3e0bd475 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:18.438217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5a88a-7693-49fb-9dba-aa68b383a9be None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:18.438812 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5a88a-7693-49fb-9dba-aa68b383a9be None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:18.439331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5a88a-7693-49fb-9dba-aa68b383a9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:18.460587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-37c5a88a-7693-49fb-9dba-aa68b383a9be None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:18.462076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-37c5a88a-7693-49fb-9dba-aa68b383a9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:18.520051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 982/1976] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:18.527820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f74951-2f30-47ea-b2b5-e59ccfc6f5e2 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:18.528112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f74951-2f30-47ea-b2b5-e59ccfc6f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:18.528394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f74951-2f30-47ea-b2b5-e59ccfc6f5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:18.547663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-97f74951-2f30-47ea-b2b5-e59ccfc6f5e2 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:18.548865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-97f74951-2f30-47ea-b2b5-e59ccfc6f5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:18.557696 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 995/1977] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:18.561954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5a88a-7693-49fb-9dba-aa68b383a9be None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:18.573044 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5a88a-7693-49fb-9dba-aa68b383a9be None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:18.578253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ec99-cdac-4cb6-a6ab-ec32f2754583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:18.579060 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ec99-cdac-4cb6-a6ab-ec32f2754583 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:18.579341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ec99-cdac-4cb6-a6ab-ec32f2754583 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:18.579619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ec99-cdac-4cb6-a6ab-ec32f2754583 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:18.580363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ec99-cdac-4cb6-a6ab-ec32f2754583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:18.580703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ec99-cdac-4cb6-a6ab-ec32f2754583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:18.582287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ec99-cdac-4cb6-a6ab-ec32f2754583 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:18.597679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 983/1978] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:51:18.601910 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f74951-2f30-47ea-b2b5-e59ccfc6f5e2 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:18.611090 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f74951-2f30-47ea-b2b5-e59ccfc6f5e2 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:18.615982 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db492fc-73bd-4d2c-8499-6790ec920b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:18.616687 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db492fc-73bd-4d2c-8499-6790ec920b99 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:18.616970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db492fc-73bd-4d2c-8499-6790ec920b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:18.617772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db492fc-73bd-4d2c-8499-6790ec920b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:18.618573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db492fc-73bd-4d2c-8499-6790ec920b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:18.620474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db492fc-73bd-4d2c-8499-6790ec920b99 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:18.648190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 996/1979] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:18 2022] POST /identity/v3/projects => generated 376 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:18.652677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ec99-cdac-4cb6-a6ab-ec32f2754583 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:18.663269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ec99-cdac-4cb6-a6ab-ec32f2754583 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:18.721908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc0b4-b595-45ed-ad59-80176c1c59eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:18.722608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc0b4-b595-45ed-ad59-80176c1c59eb admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:18.722925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc0b4-b595-45ed-ad59-80176c1c59eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:18.723207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc0b4-b595-45ed-ad59-80176c1c59eb admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:18.723916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bc0b4-b595-45ed-ad59-80176c1c59eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:18.725858 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bc0b4-b595-45ed-ad59-80176c1c59eb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:18.747510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 984/1980] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:18 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:18.752029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db492fc-73bd-4d2c-8499-6790ec920b99 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:18.763748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db492fc-73bd-4d2c-8499-6790ec920b99 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:18.769468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527599f-e866-4a9a-8aab-e01c58543445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:18.770138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527599f-e866-4a9a-8aab-e01c58543445 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:18.770585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527599f-e866-4a9a-8aab-e01c58543445 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:18.770901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527599f-e866-4a9a-8aab-e01c58543445 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:18.771807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527599f-e866-4a9a-8aab-e01c58543445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:18.774114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527599f-e866-4a9a-8aab-e01c58543445 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:18.786170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 997/1981] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:18 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:18.791002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc0b4-b595-45ed-ad59-80176c1c59eb admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:18.801420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc0b4-b595-45ed-ad59-80176c1c59eb admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:18.806926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecba290-a469-457a-a188-207bf8d1922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:18.807704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecba290-a469-457a-a188-207bf8d1922c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:18.807989 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecba290-a469-457a-a188-207bf8d1922c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:18.808272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecba290-a469-457a-a188-207bf8d1922c admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:18.809026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecba290-a469-457a-a188-207bf8d1922c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:18.810785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecba290-a469-457a-a188-207bf8d1922c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:18.821975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 985/1982] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:18 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:51:18.826277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527599f-e866-4a9a-8aab-e01c58543445 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:18.842435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527599f-e866-4a9a-8aab-e01c58543445 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:18.844561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6c7d-9792-418b-a28f-323b26676876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:18.846017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6c7d-9792-418b-a28f-323b26676876 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:18.846445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6c7d-9792-418b-a28f-323b26676876 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:18.846980 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6c7d-9792-418b-a28f-323b26676876 admin admin] PATH_INFO: `/v3/projects/e711c82de9fb4acf9a9079c0abfb62de/users/b040fdf94e0d43ad9b832fdf046ab6d8/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:18.865697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af6c7d-9792-418b-a28f-323b26676876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e711c82de9fb4acf9a9079c0abfb62de, user_id=b040fdf94e0d43ad9b832fdf046ab6d8, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:18.869438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af6c7d-9792-418b-a28f-323b26676876 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:18.891984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 998/1983] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:18 2022] PUT /identity/v3/projects/e711c82de9fb4acf9a9079c0abfb62de/users/b040fdf94e0d43ad9b832fdf046ab6d8/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:18.904826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964fff9-796c-4c88-aacf-65ea1241c271 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:18.905057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964fff9-796c-4c88-aacf-65ea1241c271 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:18.905317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964fff9-796c-4c88-aacf-65ea1241c271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:18.937392 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-1964fff9-796c-4c88-aacf-65ea1241c271 None None] MFA Rules not processed for user `b040fdf94e0d43ad9b832fdf046ab6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:18.938952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1964fff9-796c-4c88-aacf-65ea1241c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:19.013625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 986/1984] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:19.024266 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6c7d-9792-418b-a28f-323b26676876 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:19.026045 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e6af6c7d-9792-418b-a28f-323b26676876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:19.084901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6c7d-9792-418b-a28f-323b26676876 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:19.088875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ae6f7-14bb-4610-a900-63714ffb89eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:19.089510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae6f7-14bb-4610-a900-63714ffb89eb service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:19.089789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae6f7-14bb-4610-a900-63714ffb89eb service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:19.090089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae6f7-14bb-4610-a900-63714ffb89eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:19.099121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ae6f7-14bb-4610-a900-63714ffb89eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:19.100528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ae6f7-14bb-4610-a900-63714ffb89eb service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:19.111442 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 999/1985] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:19.495008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262c1e-401c-4d57-b7ff-3accf279682e None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:19.495307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262c1e-401c-4d57-b7ff-3accf279682e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:19.495589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262c1e-401c-4d57-b7ff-3accf279682e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:19.514589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-f9262c1e-401c-4d57-b7ff-3accf279682e None None] MFA Rules not processed for user `feb8ddf0abd84c1caed8501c57b56f20`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:19.515896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f9262c1e-401c-4d57-b7ff-3accf279682e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:19.572314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 987/1986] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:20.184736 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ae6f7-14bb-4610-a900-63714ffb89eb service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:20.189308 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-590ae6f7-14bb-4610-a900-63714ffb89eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:20.312592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ae6f7-14bb-4610-a900-63714ffb89eb service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:20.318798 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3666c5b-9424-473f-bf20-fc8918fa9ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:20.319821 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666c5b-9424-473f-bf20-fc8918fa9ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:20.321477 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666c5b-9424-473f-bf20-fc8918fa9ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:20.322018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666c5b-9424-473f-bf20-fc8918fa9ceb admin admin] PATH_INFO: `/v3/users/3b9a988ccba046e399cb0f755b9a03e1` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:20.323752 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3666c5b-9424-473f-bf20-fc8918fa9ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9a988ccba046e399cb0f755b9a03e1)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:20.325498 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3666c5b-9424-473f-bf20-fc8918fa9ceb admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:20.390659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e3666c5b-9424-473f-bf20-fc8918fa9ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9a988ccba046e399cb0f755b9a03e1'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:20.405609 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e3666c5b-9424-473f-bf20-fc8918fa9ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9a988ccba046e399cb0f755b9a03e1'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:20.406444 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e3666c5b-9424-473f-bf20-fc8918fa9ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9a988ccba046e399cb0f755b9a03e1'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:20.407290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e3666c5b-9424-473f-bf20-fc8918fa9ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9a988ccba046e399cb0f755b9a03e1'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:20.420754 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e3666c5b-9424-473f-bf20-fc8918fa9ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9a988ccba046e399cb0f755b9a03e1'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:20.435003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1000/1987] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:20 2022] DELETE /identity/v3/users/3b9a988ccba046e399cb0f755b9a03e1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:20.723438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9262c1e-401c-4d57-b7ff-3accf279682e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:20.745176 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9262c1e-401c-4d57-b7ff-3accf279682e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:20.857031 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:20.857992 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:20.858275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:20.858604 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] PATH_INFO: `/v3/projects/8d59c94478d24e3f917829b148941337` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:20.859955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d59c94478d24e3f917829b148941337)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:20.862054 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:20.910128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d59c94478d24e3f917829b148941337', 'request_id': 'req-ef857206-3cc7-41a8-8c41-be9c951f2510'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:20.919029 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d59c94478d24e3f917829b148941337', 'request_id': 'req-ef857206-3cc7-41a8-8c41-be9c951f2510'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:20.925352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d59c94478d24e3f917829b148941337', 'request_id': 'req-ef857206-3cc7-41a8-8c41-be9c951f2510'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:20.936231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] The token cache is being invalidate because project 8d59c94478d24e3f917829b148941337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:20.936509 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:20.937159 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ef857206-3cc7-41a8-8c41-be9c951f2510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:20.938697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 988/1988] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:20 2022] DELETE /identity/v3/projects/8d59c94478d24e3f917829b148941337 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:20.945349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37c56e-3536-4eb3-be18-3d28769564fd None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:20.945663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37c56e-3536-4eb3-be18-3d28769564fd None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:20.945946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37c56e-3536-4eb3-be18-3d28769564fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:20.964686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-fa37c56e-3536-4eb3-be18-3d28769564fd None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:20.965986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-fa37c56e-3536-4eb3-be18-3d28769564fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:21.027445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1001/1989] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:21.035349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79050b-3e84-4399-ab64-bb52c6d37860 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.035575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79050b-3e84-4399-ab64-bb52c6d37860 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.035858 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79050b-3e84-4399-ab64-bb52c6d37860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.056690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-cf79050b-3e84-4399-ab64-bb52c6d37860 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:21.057950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-cf79050b-3e84-4399-ab64-bb52c6d37860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:21.066290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 989/1990] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:21.070788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37c56e-3536-4eb3-be18-3d28769564fd None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.080847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37c56e-3536-4eb3-be18-3d28769564fd None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.086531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed4a8e-3483-4e0f-9e2f-ea2fb7c65d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.087251 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed4a8e-3483-4e0f-9e2f-ea2fb7c65d2d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.087535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed4a8e-3483-4e0f-9e2f-ea2fb7c65d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.087808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed4a8e-3483-4e0f-9e2f-ea2fb7c65d2d admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.088537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed4a8e-3483-4e0f-9e2f-ea2fb7c65d2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:21.088840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed4a8e-3483-4e0f-9e2f-ea2fb7c65d2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.090414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed4a8e-3483-4e0f-9e2f-ea2fb7c65d2d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.106850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1002/1991] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:51:21.109970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79050b-3e84-4399-ab64-bb52c6d37860 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.119819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79050b-3e84-4399-ab64-bb52c6d37860 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.126616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7736cd1-ef81-46c8-a6a7-7402ca698806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.127320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7736cd1-ef81-46c8-a6a7-7402ca698806 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.127608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7736cd1-ef81-46c8-a6a7-7402ca698806 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.127885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7736cd1-ef81-46c8-a6a7-7402ca698806 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.128599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7736cd1-ef81-46c8-a6a7-7402ca698806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.130917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7736cd1-ef81-46c8-a6a7-7402ca698806 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.167998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 990/1992] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:21 2022] POST /identity/v3/projects => generated 400 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:21.169624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed4a8e-3483-4e0f-9e2f-ea2fb7c65d2d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.181018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed4a8e-3483-4e0f-9e2f-ea2fb7c65d2d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.239210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1648d-80d1-47ee-bd66-ce730c3ee850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.240017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1648d-80d1-47ee-bd66-ce730c3ee850 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.240403 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1648d-80d1-47ee-bd66-ce730c3ee850 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.240780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1648d-80d1-47ee-bd66-ce730c3ee850 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.241592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1648d-80d1-47ee-bd66-ce730c3ee850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.243960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1648d-80d1-47ee-bd66-ce730c3ee850 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.272395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1003/1993] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:21 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:21.279091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7736cd1-ef81-46c8-a6a7-7402ca698806 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.291283 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7736cd1-ef81-46c8-a6a7-7402ca698806 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.296058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5395ac-0537-44d3-b820-adcc8a67b5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.296928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5395ac-0537-44d3-b820-adcc8a67b5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.297132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5395ac-0537-44d3-b820-adcc8a67b5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.297409 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5395ac-0537-44d3-b820-adcc8a67b5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.298186 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5395ac-0537-44d3-b820-adcc8a67b5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.299794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5395ac-0537-44d3-b820-adcc8a67b5c1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.311600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 991/1994] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:21 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:21.315875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1648d-80d1-47ee-bd66-ce730c3ee850 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.326582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1648d-80d1-47ee-bd66-ce730c3ee850 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.331191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7f178-13d7-4dba-afa2-73b9e326e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.331951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7f178-13d7-4dba-afa2-73b9e326e16f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.332233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7f178-13d7-4dba-afa2-73b9e326e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.332509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7f178-13d7-4dba-afa2-73b9e326e16f admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.333235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7f178-13d7-4dba-afa2-73b9e326e16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.334820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7f178-13d7-4dba-afa2-73b9e326e16f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.346786 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1004/1995] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:21 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:21.349545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5395ac-0537-44d3-b820-adcc8a67b5c1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.361061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5395ac-0537-44d3-b820-adcc8a67b5c1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.369659 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a88d5e-cf7e-4406-8dd8-33fa853c6476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.370574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a88d5e-cf7e-4406-8dd8-33fa853c6476 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.370894 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a88d5e-cf7e-4406-8dd8-33fa853c6476 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.371167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a88d5e-cf7e-4406-8dd8-33fa853c6476 admin admin] PATH_INFO: `/v3/projects/1ea58f0b4e034c5cad4447de3d5ad02b/users/a72f906646a34160b17eaa984a98d305/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.386406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a88d5e-cf7e-4406-8dd8-33fa853c6476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea58f0b4e034c5cad4447de3d5ad02b, user_id=a72f906646a34160b17eaa984a98d305, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.389099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a88d5e-cf7e-4406-8dd8-33fa853c6476 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.402300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 992/1996] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:21 2022] PUT /identity/v3/projects/1ea58f0b4e034c5cad4447de3d5ad02b/users/a72f906646a34160b17eaa984a98d305/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:51:21.412581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8a54-1dfd-4e57-b00e-28ce088b8fda None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.412866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8a54-1dfd-4e57-b00e-28ce088b8fda None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.414272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8a54-1dfd-4e57-b00e-28ce088b8fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.450233 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-3c9b8a54-1dfd-4e57-b00e-28ce088b8fda None None] MFA Rules not processed for user `a72f906646a34160b17eaa984a98d305`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:21.452309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3c9b8a54-1dfd-4e57-b00e-28ce088b8fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:21.550349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1005/1997] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:21.563246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a88d5e-cf7e-4406-8dd8-33fa853c6476 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.632703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a88d5e-cf7e-4406-8dd8-33fa853c6476 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.640942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c7139-238d-4669-b190-509bcde50492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.641947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c7139-238d-4669-b190-509bcde50492 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.642294 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c7139-238d-4669-b190-509bcde50492 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.642745 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c7139-238d-4669-b190-509bcde50492 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.643621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c7139-238d-4669-b190-509bcde50492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.645827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c7139-238d-4669-b190-509bcde50492 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.674943 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 993/1998] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:21 2022] POST /identity/v3/projects => generated 402 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:21.676925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b8a54-1dfd-4e57-b00e-28ce088b8fda None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.689347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b8a54-1dfd-4e57-b00e-28ce088b8fda None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.751399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4497af-3f1c-47bb-a3b5-5b2376341d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.752241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4497af-3f1c-47bb-a3b5-5b2376341d80 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.752554 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4497af-3f1c-47bb-a3b5-5b2376341d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.752999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4497af-3f1c-47bb-a3b5-5b2376341d80 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.754184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4497af-3f1c-47bb-a3b5-5b2376341d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.755997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4497af-3f1c-47bb-a3b5-5b2376341d80 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.774027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c7139-238d-4669-b190-509bcde50492 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.776226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-932c7139-238d-4669-b190-509bcde50492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:21.779259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1006/1999] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:21 2022] POST /identity/v3/users => generated 308 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:21.783117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4497af-3f1c-47bb-a3b5-5b2376341d80 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.789735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c7139-238d-4669-b190-509bcde50492 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.795188 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873b957-cd55-44e8-8caa-6303d59a0d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.796156 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873b957-cd55-44e8-8caa-6303d59a0d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.796436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873b957-cd55-44e8-8caa-6303d59a0d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.796657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4497af-3f1c-47bb-a3b5-5b2376341d80 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.796766 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873b957-cd55-44e8-8caa-6303d59a0d1b admin admin] PATH_INFO: `/v3/users/640ddae1dd784c7db896217ffeec8d98` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.797914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873b957-cd55-44e8-8caa-6303d59a0d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=640ddae1dd784c7db896217ffeec8d98)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.803701 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873b957-cd55-44e8-8caa-6303d59a0d1b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.804125 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f038d6e-eeaa-4eb2-bbbe-e33c7dadfe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.805318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038d6e-eeaa-4eb2-bbbe-e33c7dadfe56 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.805942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038d6e-eeaa-4eb2-bbbe-e33c7dadfe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.806224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038d6e-eeaa-4eb2-bbbe-e33c7dadfe56 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.807269 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f038d6e-eeaa-4eb2-bbbe-e33c7dadfe56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.809560 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f038d6e-eeaa-4eb2-bbbe-e33c7dadfe56 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.822049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1007/2000] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:21 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:51:21.826861 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f038d6e-eeaa-4eb2-bbbe-e33c7dadfe56 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.838072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f038d6e-eeaa-4eb2-bbbe-e33c7dadfe56 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.844207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bdd66-d8ed-4b47-89de-9737d1a9105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.845204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bdd66-d8ed-4b47-89de-9737d1a9105b admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.845589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bdd66-d8ed-4b47-89de-9737d1a9105b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.845884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bdd66-d8ed-4b47-89de-9737d1a9105b admin admin] PATH_INFO: `/v3/projects/22786afd373c420eb2c9e2743e41e606/users/306bc64488ab492b990eb9dce68927d6/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.861286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d873b957-cd55-44e8-8caa-6303d59a0d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '640ddae1dd784c7db896217ffeec8d98'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:21.862951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bdd66-d8ed-4b47-89de-9737d1a9105b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22786afd373c420eb2c9e2743e41e606, user_id=306bc64488ab492b990eb9dce68927d6, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.865791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bdd66-d8ed-4b47-89de-9737d1a9105b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.872616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d873b957-cd55-44e8-8caa-6303d59a0d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '640ddae1dd784c7db896217ffeec8d98'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:21.880656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d873b957-cd55-44e8-8caa-6303d59a0d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '640ddae1dd784c7db896217ffeec8d98'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:21.880806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1008/2001] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:21 2022] PUT /identity/v3/projects/22786afd373c420eb2c9e2743e41e606/users/306bc64488ab492b990eb9dce68927d6/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:51:21.885356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bdd66-d8ed-4b47-89de-9737d1a9105b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:21.895011 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d873b957-cd55-44e8-8caa-6303d59a0d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '640ddae1dd784c7db896217ffeec8d98'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:21.895733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d873b957-cd55-44e8-8caa-6303d59a0d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '640ddae1dd784c7db896217ffeec8d98'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:21.902681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 994/2002] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:21 2022] DELETE /identity/v3/users/640ddae1dd784c7db896217ffeec8d98 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:21.907128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436621b-9d5f-45e3-a8dc-c7e0d76e9a92 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.907410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436621b-9d5f-45e3-a8dc-c7e0d76e9a92 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.907690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436621b-9d5f-45e3-a8dc-c7e0d76e9a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.925493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e436621b-9d5f-45e3-a8dc-c7e0d76e9a92 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:21.926694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e436621b-9d5f-45e3-a8dc-c7e0d76e9a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:21.983226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bdd66-d8ed-4b47-89de-9737d1a9105b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:21.988592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c714a-ede8-4f87-954f-4bf3a2bd0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:21.989266 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c714a-ede8-4f87-954f-4bf3a2bd0152 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:21.989384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 995/2003] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:21.989551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c714a-ede8-4f87-954f-4bf3a2bd0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:21.989829 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c714a-ede8-4f87-954f-4bf3a2bd0152 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:21.990775 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c714a-ede8-4f87-954f-4bf3a2bd0152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:21.992959 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c714a-ede8-4f87-954f-4bf3a2bd0152 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:21.999766 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436621b-9d5f-45e3-a8dc-c7e0d76e9a92 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:22.001256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e436621b-9d5f-45e3-a8dc-c7e0d76e9a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:22.006351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1009/2004] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:21 2022] GET /identity/v3/roles => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:51:22.007350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c714a-ede8-4f87-954f-4bf3a2bd0152 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:22.009536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8b7c714a-ede8-4f87-954f-4bf3a2bd0152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:22.021605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c714a-ede8-4f87-954f-4bf3a2bd0152 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:22.026637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2ab17-9d39-4e73-81e7-7571ba9a0cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:22.027539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2ab17-9d39-4e73-81e7-7571ba9a0cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:22.027821 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2ab17-9d39-4e73-81e7-7571ba9a0cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:22.028089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2ab17-9d39-4e73-81e7-7571ba9a0cd6 admin admin] PATH_INFO: `/v3/projects/22786afd373c420eb2c9e2743e41e606/users/306bc64488ab492b990eb9dce68927d6/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:22.030166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2ab17-9d39-4e73-81e7-7571ba9a0cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22786afd373c420eb2c9e2743e41e606, user_id=306bc64488ab492b990eb9dce68927d6, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:22.032803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2ab17-9d39-4e73-81e7-7571ba9a0cd6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:22.043347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1010/2005] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:22 2022] PUT /identity/v3/projects/22786afd373c420eb2c9e2743e41e606/users/306bc64488ab492b990eb9dce68927d6/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:22.053415 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd378-75c9-4e30-813f-5dc2d0d9a2a8 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:22.053632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd378-75c9-4e30-813f-5dc2d0d9a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:22.053910 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd378-75c9-4e30-813f-5dc2d0d9a2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:22.057985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436621b-9d5f-45e3-a8dc-c7e0d76e9a92 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:22.081608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-e9ecd378-75c9-4e30-813f-5dc2d0d9a2a8 None None] MFA Rules not processed for user `306bc64488ab492b990eb9dce68927d6`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:22.082878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e9ecd378-75c9-4e30-813f-5dc2d0d9a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:22.106964 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b4bf8-2407-49df-a7db-825100fdd2d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:22.107611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b4bf8-2407-49df-a7db-825100fdd2d7 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:22.107888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b4bf8-2407-49df-a7db-825100fdd2d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:22.108160 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b4bf8-2407-49df-a7db-825100fdd2d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:22.154697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1011/2006] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:22.164653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecd378-75c9-4e30-813f-5dc2d0d9a2a8 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:22.166124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e9ecd378-75c9-4e30-813f-5dc2d0d9a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:22.167659 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b4bf8-2407-49df-a7db-825100fdd2d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:22.169132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b4bf8-2407-49df-a7db-825100fdd2d7 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:22.178548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 996/2007] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:51:22.221830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecd378-75c9-4e30-813f-5dc2d0d9a2a8 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:22.225670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376d1d3-6da9-4751-b0ec-ae3b374ac282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:22.226859 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d1d3-6da9-4751-b0ec-ae3b374ac282 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:22.227144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d1d3-6da9-4751-b0ec-ae3b374ac282 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:22.227418 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d1d3-6da9-4751-b0ec-ae3b374ac282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:22.236662 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376d1d3-6da9-4751-b0ec-ae3b374ac282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:22.238105 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376d1d3-6da9-4751-b0ec-ae3b374ac282 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:22.248388 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1012/2008] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:22 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:51:22.323581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b4bf8-2407-49df-a7db-825100fdd2d7 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:22.333429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b4bf8-2407-49df-a7db-825100fdd2d7 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:22.339048 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a9f6f-ec74-48fb-904f-4503c65e6efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:22.339702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a9f6f-ec74-48fb-904f-4503c65e6efb service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:22.340012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a9f6f-ec74-48fb-904f-4503c65e6efb service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:22.340791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a9f6f-ec74-48fb-904f-4503c65e6efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:22.342951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-643a9f6f-ec74-48fb-904f-4503c65e6efb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:22.402667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a9f6f-ec74-48fb-904f-4503c65e6efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:22.404143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a9f6f-ec74-48fb-904f-4503c65e6efb service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:22.413189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 997/2009] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:22.449271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376d1d3-6da9-4751-b0ec-ae3b374ac282 service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:22.450895 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a376d1d3-6da9-4751-b0ec-ae3b374ac282 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:22.466171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376d1d3-6da9-4751-b0ec-ae3b374ac282 service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:22.472692 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:22.473902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:22.474262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:22.474627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] PATH_INFO: `/v3/projects/0120ee4b24f346d180090114159bbaf7` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:22.476406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0120ee4b24f346d180090114159bbaf7)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:22.478350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:22.530084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0120ee4b24f346d180090114159bbaf7', 'request_id': 'req-35e86984-2df9-48b8-b421-d3cdc4e73e31'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:22.536108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0120ee4b24f346d180090114159bbaf7', 'request_id': 'req-35e86984-2df9-48b8-b421-d3cdc4e73e31'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:22.544220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0120ee4b24f346d180090114159bbaf7', 'request_id': 'req-35e86984-2df9-48b8-b421-d3cdc4e73e31'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:22.556737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] The token cache is being invalidate because project 0120ee4b24f346d180090114159bbaf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:22.557046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:22.557712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:22.559399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1013/2010] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:22 2022] DELETE /identity/v3/projects/0120ee4b24f346d180090114159bbaf7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:22.564183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a9f6f-ec74-48fb-904f-4503c65e6efb service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:22.575728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a9f6f-ec74-48fb-904f-4503c65e6efb service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:22.633145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d35b6c-2c06-4086-b4f8-9cdd9feec916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:22.634010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d35b6c-2c06-4086-b4f8-9cdd9feec916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:22.634290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d35b6c-2c06-4086-b4f8-9cdd9feec916 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:22.634563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d35b6c-2c06-4086-b4f8-9cdd9feec916 admin admin] PATH_INFO: `/v3/users/2bb79e88ad6440b0987ee396c89fed9c` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:22.635815 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d35b6c-2c06-4086-b4f8-9cdd9feec916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb79e88ad6440b0987ee396c89fed9c)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:22.637734 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d35b6c-2c06-4086-b4f8-9cdd9feec916 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:22.701126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-74d35b6c-2c06-4086-b4f8-9cdd9feec916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb79e88ad6440b0987ee396c89fed9c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:22.709070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-74d35b6c-2c06-4086-b4f8-9cdd9feec916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb79e88ad6440b0987ee396c89fed9c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:22.717117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-74d35b6c-2c06-4086-b4f8-9cdd9feec916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb79e88ad6440b0987ee396c89fed9c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:22.729026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-74d35b6c-2c06-4086-b4f8-9cdd9feec916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb79e88ad6440b0987ee396c89fed9c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:22.729740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-74d35b6c-2c06-4086-b4f8-9cdd9feec916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb79e88ad6440b0987ee396c89fed9c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:22.736694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 998/2011] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:22 2022] DELETE /identity/v3/users/2bb79e88ad6440b0987ee396c89fed9c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:23.000032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.001467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:23.017123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86984-2df9-48b8-b421-d3cdc4e73e31 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:23.073169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:23.074077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.074363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.074638 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] PATH_INFO: `/v3/projects/b0e4be9ae5654aa897b13466d248bfb6` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.075946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e4be9ae5654aa897b13466d248bfb6)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:23.077779 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:23.122124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e4be9ae5654aa897b13466d248bfb6', 'request_id': 'req-9cda36fb-c80d-4159-9447-1cb2ee60b76b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:23.127419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e4be9ae5654aa897b13466d248bfb6', 'request_id': 'req-9cda36fb-c80d-4159-9447-1cb2ee60b76b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:23.134652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e4be9ae5654aa897b13466d248bfb6', 'request_id': 'req-9cda36fb-c80d-4159-9447-1cb2ee60b76b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:23.145511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] The token cache is being invalidate because project b0e4be9ae5654aa897b13466d248bfb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:23.145793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:23.146466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9cda36fb-c80d-4159-9447-1cb2ee60b76b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:23.148565 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1014/2012] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:22 2022] DELETE /identity/v3/projects/b0e4be9ae5654aa897b13466d248bfb6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:23.155568 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f687be4-250d-4016-a354-634123d10b69 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.156034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f687be4-250d-4016-a354-634123d10b69 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.156137 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f687be4-250d-4016-a354-634123d10b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.174998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-6f687be4-250d-4016-a354-634123d10b69 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:23.176192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-6f687be4-250d-4016-a354-634123d10b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:23.234929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 999/2013] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:23.243428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d27c1-bd3f-4875-8ccd-f42a870b3a8d None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.243711 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d27c1-bd3f-4875-8ccd-f42a870b3a8d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.243984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d27c1-bd3f-4875-8ccd-f42a870b3a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.261916 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-aa7d27c1-bd3f-4875-8ccd-f42a870b3a8d None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:23.263107 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-aa7d27c1-bd3f-4875-8ccd-f42a870b3a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:23.280333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1015/2014] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:23.284604 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f687be4-250d-4016-a354-634123d10b69 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.294608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f687be4-250d-4016-a354-634123d10b69 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:23.299121 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ced331-671f-42cd-b8db-5d71aa6106c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:23.299762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ced331-671f-42cd-b8db-5d71aa6106c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.300040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ced331-671f-42cd-b8db-5d71aa6106c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.300308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ced331-671f-42cd-b8db-5d71aa6106c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.301033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ced331-671f-42cd-b8db-5d71aa6106c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:23.301348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ced331-671f-42cd-b8db-5d71aa6106c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:23.302935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ced331-671f-42cd-b8db-5d71aa6106c8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:23.313903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1000/2015] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:51:23.318271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d27c1-bd3f-4875-8ccd-f42a870b3a8d None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.327577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d27c1-bd3f-4875-8ccd-f42a870b3a8d None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:23.332117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88fd39-0d3f-45d2-9f0f-c8b242d162c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:23.332750 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88fd39-0d3f-45d2-9f0f-c8b242d162c4 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.333033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88fd39-0d3f-45d2-9f0f-c8b242d162c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.333309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88fd39-0d3f-45d2-9f0f-c8b242d162c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.334015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88fd39-0d3f-45d2-9f0f-c8b242d162c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:23.336669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88fd39-0d3f-45d2-9f0f-c8b242d162c4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:23.361076 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1016/2016] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:23 2022] POST /identity/v3/projects => generated 386 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:23.365152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ced331-671f-42cd-b8db-5d71aa6106c8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.375123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ced331-671f-42cd-b8db-5d71aa6106c8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:23.429647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8de96-0d7a-4d50-ac8c-c76661a96566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:23.430367 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8de96-0d7a-4d50-ac8c-c76661a96566 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.430648 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8de96-0d7a-4d50-ac8c-c76661a96566 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.430954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8de96-0d7a-4d50-ac8c-c76661a96566 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.431655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8de96-0d7a-4d50-ac8c-c76661a96566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:23.433599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8de96-0d7a-4d50-ac8c-c76661a96566 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:23.453247 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1001/2017] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:23 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:23.457522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88fd39-0d3f-45d2-9f0f-c8b242d162c4 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.468277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88fd39-0d3f-45d2-9f0f-c8b242d162c4 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:23.473081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916f52a-d76f-4404-a59f-1a70ce5589fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:23.473727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f52a-d76f-4404-a59f-1a70ce5589fc admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.474008 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f52a-d76f-4404-a59f-1a70ce5589fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.474281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f52a-d76f-4404-a59f-1a70ce5589fc admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.475055 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916f52a-d76f-4404-a59f-1a70ce5589fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:23.476811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916f52a-d76f-4404-a59f-1a70ce5589fc admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:23.487166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1017/2018] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:23 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:23.491010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8de96-0d7a-4d50-ac8c-c76661a96566 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.500903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8de96-0d7a-4d50-ac8c-c76661a96566 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:23.505500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa0b62-9ec6-4f36-95a8-a3dd5615eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:23.506147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa0b62-9ec6-4f36-95a8-a3dd5615eb1e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.506428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa0b62-9ec6-4f36-95a8-a3dd5615eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.506703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa0b62-9ec6-4f36-95a8-a3dd5615eb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.508526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa0b62-9ec6-4f36-95a8-a3dd5615eb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:23.510114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa0b62-9ec6-4f36-95a8-a3dd5615eb1e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:23.519997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1002/2019] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:23 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:23.524629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916f52a-d76f-4404-a59f-1a70ce5589fc admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.534377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916f52a-d76f-4404-a59f-1a70ce5589fc admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:23.539772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ba57-ff0d-45b8-ac4f-7ad38a5d0b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:23.540641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ba57-ff0d-45b8-ac4f-7ad38a5d0b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.540925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ba57-ff0d-45b8-ac4f-7ad38a5d0b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.541200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ba57-ff0d-45b8-ac4f-7ad38a5d0b2d admin admin] PATH_INFO: `/v3/projects/96cb97aa2b734b978e17f7a7eb7e30bc/users/83aed2e0510a4d58a2c7c4563cdc1a3b/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.556554 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3ba57-ff0d-45b8-ac4f-7ad38a5d0b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96cb97aa2b734b978e17f7a7eb7e30bc, user_id=83aed2e0510a4d58a2c7c4563cdc1a3b, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:23.559255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3ba57-ff0d-45b8-ac4f-7ad38a5d0b2d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:23.573107 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1018/2020] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:23 2022] PUT /identity/v3/projects/96cb97aa2b734b978e17f7a7eb7e30bc/users/83aed2e0510a4d58a2c7c4563cdc1a3b/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:23.583548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b9a14-e1be-496a-95ab-68604e4f63c6 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.583778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b9a14-e1be-496a-95ab-68604e4f63c6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.584079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b9a14-e1be-496a-95ab-68604e4f63c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.611537 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b09b9a14-e1be-496a-95ab-68604e4f63c6 None None] MFA Rules not processed for user `83aed2e0510a4d58a2c7c4563cdc1a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:23.612743 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b09b9a14-e1be-496a-95ab-68604e4f63c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:23.675340 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1003/2021] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:23.680795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ba57-ff0d-45b8-ac4f-7ad38a5d0b2d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.741134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ba57-ff0d-45b8-ac4f-7ad38a5d0b2d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:23.746709 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a29199-2bf7-4be1-93ab-9ec09ee1d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:23.747398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a29199-2bf7-4be1-93ab-9ec09ee1d4ee admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.747679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a29199-2bf7-4be1-93ab-9ec09ee1d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.747952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a29199-2bf7-4be1-93ab-9ec09ee1d4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.748663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a29199-2bf7-4be1-93ab-9ec09ee1d4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:23.750531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a29199-2bf7-4be1-93ab-9ec09ee1d4ee admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:23.777262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1019/2022] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:23 2022] POST /identity/v3/projects => generated 388 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:23.781250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b9a14-e1be-496a-95ab-68604e4f63c6 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.792401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b9a14-e1be-496a-95ab-68604e4f63c6 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:23.848440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221ecc7-1fb8-4638-af24-5ba193c80824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:23.849359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221ecc7-1fb8-4638-af24-5ba193c80824 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.849642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221ecc7-1fb8-4638-af24-5ba193c80824 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.849920 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221ecc7-1fb8-4638-af24-5ba193c80824 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.850634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221ecc7-1fb8-4638-af24-5ba193c80824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:23.853456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221ecc7-1fb8-4638-af24-5ba193c80824 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:23.877311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1004/2023] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:23 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:23.879331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a29199-2bf7-4be1-93ab-9ec09ee1d4ee admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.890255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a29199-2bf7-4be1-93ab-9ec09ee1d4ee admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:23.894949 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4099-9b64-4a9b-8b14-92e12c3aa8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:23.895602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4099-9b64-4a9b-8b14-92e12c3aa8df admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.895889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4099-9b64-4a9b-8b14-92e12c3aa8df admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.896164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4099-9b64-4a9b-8b14-92e12c3aa8df admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.896900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa4099-9b64-4a9b-8b14-92e12c3aa8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:23.899547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa4099-9b64-4a9b-8b14-92e12c3aa8df admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:23.909902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1020/2024] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:23 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:23.914972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221ecc7-1fb8-4638-af24-5ba193c80824 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.924945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221ecc7-1fb8-4638-af24-5ba193c80824 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:23.929747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb493d-66ce-4cf2-9b9d-075157df299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:23.930606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb493d-66ce-4cf2-9b9d-075157df299b admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:23.930932 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb493d-66ce-4cf2-9b9d-075157df299b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:23.931211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb493d-66ce-4cf2-9b9d-075157df299b admin admin] PATH_INFO: `/v3/projects/385c73598ea3473198db476bc4f73903/users/e1303a4e7afc4b84bf7fbd37478bc4d3/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:23.945750 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb493d-66ce-4cf2-9b9d-075157df299b admin admin] RBAC: Authorizing `identity:create_grant(project_id=385c73598ea3473198db476bc4f73903, user_id=e1303a4e7afc4b84bf7fbd37478bc4d3, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:23.948419 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb493d-66ce-4cf2-9b9d-075157df299b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:23.962036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1005/2025] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:23 2022] PUT /identity/v3/projects/385c73598ea3473198db476bc4f73903/users/e1303a4e7afc4b84bf7fbd37478bc4d3/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:23.965954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4099-9b64-4a9b-8b14-92e12c3aa8df admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:23.975905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4099-9b64-4a9b-8b14-92e12c3aa8df admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:24.030958 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d142b19-8df6-416e-a8ab-ba5bcb3e3cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:24.031647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d142b19-8df6-416e-a8ab-ba5bcb3e3cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:24.031929 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d142b19-8df6-416e-a8ab-ba5bcb3e3cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:24.032204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d142b19-8df6-416e-a8ab-ba5bcb3e3cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:24.032941 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d142b19-8df6-416e-a8ab-ba5bcb3e3cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:24.034529 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d142b19-8df6-416e-a8ab-ba5bcb3e3cf8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:24.044993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1021/2026] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:23 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:51:24.049088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb493d-66ce-4cf2-9b9d-075157df299b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:24.059642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb493d-66ce-4cf2-9b9d-075157df299b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:24.064173 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4cbc3-885d-473e-bd53-0d132bdc0fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:24.065292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4cbc3-885d-473e-bd53-0d132bdc0fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:24.065571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4cbc3-885d-473e-bd53-0d132bdc0fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:24.065842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4cbc3-885d-473e-bd53-0d132bdc0fa5 admin admin] PATH_INFO: `/v3/projects/385c73598ea3473198db476bc4f73903/users/e1303a4e7afc4b84bf7fbd37478bc4d3/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:24.067824 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4cbc3-885d-473e-bd53-0d132bdc0fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385c73598ea3473198db476bc4f73903, user_id=e1303a4e7afc4b84bf7fbd37478bc4d3, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:24.070679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4cbc3-885d-473e-bd53-0d132bdc0fa5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:24.080647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1006/2027] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:24 2022] PUT /identity/v3/projects/385c73598ea3473198db476bc4f73903/users/e1303a4e7afc4b84bf7fbd37478bc4d3/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:51:24.091207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485a92-675d-482b-8ea8-43fa43a3167b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:24.091493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485a92-675d-482b-8ea8-43fa43a3167b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:24.091769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485a92-675d-482b-8ea8-43fa43a3167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:24.118052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-90485a92-675d-482b-8ea8-43fa43a3167b None None] MFA Rules not processed for user `e1303a4e7afc4b84bf7fbd37478bc4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:24.119194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-90485a92-675d-482b-8ea8-43fa43a3167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:24.185467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1022/2028] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:24.200467 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4cbc3-885d-473e-bd53-0d132bdc0fa5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:24.202291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-65e4cbc3-885d-473e-bd53-0d132bdc0fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:24.258842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4cbc3-885d-473e-bd53-0d132bdc0fa5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:24.262565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fcee5-0433-47d6-98d7-f01e14cca6f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:24.263233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fcee5-0433-47d6-98d7-f01e14cca6f7 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:24.263747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fcee5-0433-47d6-98d7-f01e14cca6f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:24.264033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fcee5-0433-47d6-98d7-f01e14cca6f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:24.273263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fcee5-0433-47d6-98d7-f01e14cca6f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:24.275521 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fcee5-0433-47d6-98d7-f01e14cca6f7 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:24.285166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1007/2029] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:24.311985 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90485a92-675d-482b-8ea8-43fa43a3167b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:24.381955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90485a92-675d-482b-8ea8-43fa43a3167b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:24.387815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:24.389191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:24.389191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:24.389376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] PATH_INFO: `/v3/users/83aed2e0510a4d58a2c7c4563cdc1a3b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:24.393733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83aed2e0510a4d58a2c7c4563cdc1a3b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:24.395692 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:24.455255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83aed2e0510a4d58a2c7c4563cdc1a3b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:24.469206 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83aed2e0510a4d58a2c7c4563cdc1a3b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:24.470347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83aed2e0510a4d58a2c7c4563cdc1a3b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:24.473309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83aed2e0510a4d58a2c7c4563cdc1a3b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:24.483228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83aed2e0510a4d58a2c7c4563cdc1a3b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:24.497219 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1023/2030] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:24 2022] DELETE /identity/v3/users/83aed2e0510a4d58a2c7c4563cdc1a3b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:24.501791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d2905-c0a8-4122-b960-98f0d5eb41ca None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:24.502151 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d2905-c0a8-4122-b960-98f0d5eb41ca None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:24.502499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d2905-c0a8-4122-b960-98f0d5eb41ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:24.525845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7a4d2905-c0a8-4122-b960-98f0d5eb41ca None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:24.530785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7a4d2905-c0a8-4122-b960-98f0d5eb41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:24.603591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1008/2031] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:24.614675 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:24.616127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:24.673535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6a7a3-5ca7-4234-af4b-f28f47c39e19 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:24.677172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6c535-7578-4672-a8d1-d500f1d2b89a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:24.677811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c535-7578-4672-a8d1-d500f1d2b89a service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:24.678092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c535-7578-4672-a8d1-d500f1d2b89a service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:24.678367 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c535-7578-4672-a8d1-d500f1d2b89a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:24.688082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6c535-7578-4672-a8d1-d500f1d2b89a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:24.689526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6c535-7578-4672-a8d1-d500f1d2b89a service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:24.700027 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1024/2032] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:25.019465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d2905-c0a8-4122-b960-98f0d5eb41ca None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:25.021099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7a4d2905-c0a8-4122-b960-98f0d5eb41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:25.048281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d2905-c0a8-4122-b960-98f0d5eb41ca None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:25.067749 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:25.068627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:25.069216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:25.069335 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] PATH_INFO: `/v3/projects/96cb97aa2b734b978e17f7a7eb7e30bc` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:25.073495 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96cb97aa2b734b978e17f7a7eb7e30bc)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:25.077634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:25.175690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96cb97aa2b734b978e17f7a7eb7e30bc', 'request_id': 'req-4c7b473f-516d-4b91-9268-e59a95d6a301'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:25.192425 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96cb97aa2b734b978e17f7a7eb7e30bc', 'request_id': 'req-4c7b473f-516d-4b91-9268-e59a95d6a301'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:25.208691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96cb97aa2b734b978e17f7a7eb7e30bc', 'request_id': 'req-4c7b473f-516d-4b91-9268-e59a95d6a301'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:25.253908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] The token cache is being invalidate because project 96cb97aa2b734b978e17f7a7eb7e30bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:25.254908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:25.261647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:25.263873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1009/2033] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:25 2022] DELETE /identity/v3/projects/96cb97aa2b734b978e17f7a7eb7e30bc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:25.267850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6c535-7578-4672-a8d1-d500f1d2b89a service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:25.279409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6c535-7578-4672-a8d1-d500f1d2b89a service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:25.350038 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c6bd0-4d5a-4e61-bf20-0a545d856d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:25.351062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c6bd0-4d5a-4e61-bf20-0a545d856d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:25.351872 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c6bd0-4d5a-4e61-bf20-0a545d856d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:25.352472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c6bd0-4d5a-4e61-bf20-0a545d856d35 admin admin] PATH_INFO: `/v3/users/e1303a4e7afc4b84bf7fbd37478bc4d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:25.353509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c6bd0-4d5a-4e61-bf20-0a545d856d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1303a4e7afc4b84bf7fbd37478bc4d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:25.355526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c6bd0-4d5a-4e61-bf20-0a545d856d35 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:25.411810 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c11c6bd0-4d5a-4e61-bf20-0a545d856d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1303a4e7afc4b84bf7fbd37478bc4d3'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:25.428049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c11c6bd0-4d5a-4e61-bf20-0a545d856d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1303a4e7afc4b84bf7fbd37478bc4d3'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:25.428828 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c11c6bd0-4d5a-4e61-bf20-0a545d856d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1303a4e7afc4b84bf7fbd37478bc4d3'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:25.430129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c11c6bd0-4d5a-4e61-bf20-0a545d856d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1303a4e7afc4b84bf7fbd37478bc4d3'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:25.438454 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c11c6bd0-4d5a-4e61-bf20-0a545d856d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1303a4e7afc4b84bf7fbd37478bc4d3'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:25.454728 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1025/2034] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:25 2022] DELETE /identity/v3/users/e1303a4e7afc4b84bf7fbd37478bc4d3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:25.853179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:25.854772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:25.884186 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b473f-516d-4b91-9268-e59a95d6a301 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:25.950687 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:25.951580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:25.951856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:25.952126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] PATH_INFO: `/v3/projects/385c73598ea3473198db476bc4f73903` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:25.953313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] RBAC: Authorizing `identity:delete_project(project_id=385c73598ea3473198db476bc4f73903)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:25.955246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.003188 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385c73598ea3473198db476bc4f73903', 'request_id': 'req-680e9386-174a-4d7d-bca3-f2b07872deec'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:26.011387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385c73598ea3473198db476bc4f73903', 'request_id': 'req-680e9386-174a-4d7d-bca3-f2b07872deec'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:26.017919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385c73598ea3473198db476bc4f73903', 'request_id': 'req-680e9386-174a-4d7d-bca3-f2b07872deec'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:26.029142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] The token cache is being invalidate because project 385c73598ea3473198db476bc4f73903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:26.029435 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:26.030079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-680e9386-174a-4d7d-bca3-f2b07872deec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:26.031646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1010/2035] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:25 2022] DELETE /identity/v3/projects/385c73598ea3473198db476bc4f73903 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:26.037250 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4871d2-c731-42a7-9ac5-913200c4e12a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.037545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4871d2-c731-42a7-9ac5-913200c4e12a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.037831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4871d2-c731-42a7-9ac5-913200c4e12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.056239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-8c4871d2-c731-42a7-9ac5-913200c4e12a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:26.057437 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8c4871d2-c731-42a7-9ac5-913200c4e12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:26.115741 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1026/2036] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:26.124502 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf4e1b-7f4c-4c4b-bc84-172ba68ef8b7 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.124794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf4e1b-7f4c-4c4b-bc84-172ba68ef8b7 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.125082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf4e1b-7f4c-4c4b-bc84-172ba68ef8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.143299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-feaf4e1b-7f4c-4c4b-bc84-172ba68ef8b7 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:26.144497 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-feaf4e1b-7f4c-4c4b-bc84-172ba68ef8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:26.153382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1011/2037] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:26.157713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4871d2-c731-42a7-9ac5-913200c4e12a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.168247 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4871d2-c731-42a7-9ac5-913200c4e12a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.172810 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266cc1-b86a-4360-93cb-c48935fee3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.173446 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266cc1-b86a-4360-93cb-c48935fee3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.173727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266cc1-b86a-4360-93cb-c48935fee3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.173998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266cc1-b86a-4360-93cb-c48935fee3e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.174725 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27266cc1-b86a-4360-93cb-c48935fee3e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:26.175065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27266cc1-b86a-4360-93cb-c48935fee3e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.176677 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27266cc1-b86a-4360-93cb-c48935fee3e3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.188271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1027/2038] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:51:26.192891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf4e1b-7f4c-4c4b-bc84-172ba68ef8b7 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.202013 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf4e1b-7f4c-4c4b-bc84-172ba68ef8b7 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.206586 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fd780-9962-4a8f-b6db-79819b24bc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.207268 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd780-9962-4a8f-b6db-79819b24bc98 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.207547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd780-9962-4a8f-b6db-79819b24bc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.207817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd780-9962-4a8f-b6db-79819b24bc98 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.208526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fd780-9962-4a8f-b6db-79819b24bc98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.211005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fd780-9962-4a8f-b6db-79819b24bc98 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.236191 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1012/2039] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:26 2022] POST /identity/v3/projects => generated 382 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:26.240288 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266cc1-b86a-4360-93cb-c48935fee3e3 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.250328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266cc1-b86a-4360-93cb-c48935fee3e3 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.306841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884dbf9-0520-4c5d-bc1d-663428a4461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.307507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884dbf9-0520-4c5d-bc1d-663428a4461d admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.307787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884dbf9-0520-4c5d-bc1d-663428a4461d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.308063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884dbf9-0520-4c5d-bc1d-663428a4461d admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.308773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884dbf9-0520-4c5d-bc1d-663428a4461d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.310684 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884dbf9-0520-4c5d-bc1d-663428a4461d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.337348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1028/2040] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:26 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:26.338438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fd780-9962-4a8f-b6db-79819b24bc98 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.354975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fd780-9962-4a8f-b6db-79819b24bc98 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.362091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0e2bb-5573-4b5d-bc20-ae99c0726d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.363183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0e2bb-5573-4b5d-bc20-ae99c0726d87 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.363618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0e2bb-5573-4b5d-bc20-ae99c0726d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.364083 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0e2bb-5573-4b5d-bc20-ae99c0726d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.365213 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0e2bb-5573-4b5d-bc20-ae99c0726d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.367349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0e2bb-5573-4b5d-bc20-ae99c0726d87 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.383778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1013/2041] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:26 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:26.383867 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884dbf9-0520-4c5d-bc1d-663428a4461d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.393816 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884dbf9-0520-4c5d-bc1d-663428a4461d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.399260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b359b-896b-49cd-87f8-6059ceabe753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.400024 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b359b-896b-49cd-87f8-6059ceabe753 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.400310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b359b-896b-49cd-87f8-6059ceabe753 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.400583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b359b-896b-49cd-87f8-6059ceabe753 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.401352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b359b-896b-49cd-87f8-6059ceabe753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.402960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b359b-896b-49cd-87f8-6059ceabe753 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.413364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1029/2042] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:26 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:26.417532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0e2bb-5573-4b5d-bc20-ae99c0726d87 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.427101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0e2bb-5573-4b5d-bc20-ae99c0726d87 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.432286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deed00-9f8e-46f3-9fa5-675cdea1314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.433170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deed00-9f8e-46f3-9fa5-675cdea1314b admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.433453 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deed00-9f8e-46f3-9fa5-675cdea1314b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.433729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deed00-9f8e-46f3-9fa5-675cdea1314b admin admin] PATH_INFO: `/v3/projects/188fc8bd60674256b8108660c124b642/users/4c38aff38bb04ba7a7d519bb6a951758/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.451215 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deed00-9f8e-46f3-9fa5-675cdea1314b admin admin] RBAC: Authorizing `identity:create_grant(project_id=188fc8bd60674256b8108660c124b642, user_id=4c38aff38bb04ba7a7d519bb6a951758, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.453787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deed00-9f8e-46f3-9fa5-675cdea1314b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.468441 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1014/2043] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:26 2022] PUT /identity/v3/projects/188fc8bd60674256b8108660c124b642/users/4c38aff38bb04ba7a7d519bb6a951758/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:26.478856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd23e0-f4cf-4c51-bc77-19148c305f30 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.479156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd23e0-f4cf-4c51-bc77-19148c305f30 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.479580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd23e0-f4cf-4c51-bc77-19148c305f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.511313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-7fcd23e0-f4cf-4c51-bc77-19148c305f30 None None] MFA Rules not processed for user `4c38aff38bb04ba7a7d519bb6a951758`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:26.512683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7fcd23e0-f4cf-4c51-bc77-19148c305f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:26.591621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1030/2044] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:26.596231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deed00-9f8e-46f3-9fa5-675cdea1314b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.660362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deed00-9f8e-46f3-9fa5-675cdea1314b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.665300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500ac2-0ec6-4108-9cc0-bedd72ff5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.665951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500ac2-0ec6-4108-9cc0-bedd72ff5013 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.666239 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500ac2-0ec6-4108-9cc0-bedd72ff5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.666520 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500ac2-0ec6-4108-9cc0-bedd72ff5013 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.667276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f500ac2-0ec6-4108-9cc0-bedd72ff5013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.669163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f500ac2-0ec6-4108-9cc0-bedd72ff5013 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.693871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1015/2045] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:26 2022] POST /identity/v3/projects => generated 382 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:26.698408 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd23e0-f4cf-4c51-bc77-19148c305f30 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.708899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd23e0-f4cf-4c51-bc77-19148c305f30 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.763879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909502b-dabf-4e3f-8dd9-1542e42aabb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.764541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909502b-dabf-4e3f-8dd9-1542e42aabb7 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.764825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909502b-dabf-4e3f-8dd9-1542e42aabb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.765100 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909502b-dabf-4e3f-8dd9-1542e42aabb7 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.765819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909502b-dabf-4e3f-8dd9-1542e42aabb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.767759 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909502b-dabf-4e3f-8dd9-1542e42aabb7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.786974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1031/2046] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:26 2022] POST /identity/v3/users => generated 298 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:26.791204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500ac2-0ec6-4108-9cc0-bedd72ff5013 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.801320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500ac2-0ec6-4108-9cc0-bedd72ff5013 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.806709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd70c-3355-4bbd-99b7-537e731a93cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.807388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd70c-3355-4bbd-99b7-537e731a93cd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.807671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd70c-3355-4bbd-99b7-537e731a93cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.807945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd70c-3355-4bbd-99b7-537e731a93cd admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.808676 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bd70c-3355-4bbd-99b7-537e731a93cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.810392 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bd70c-3355-4bbd-99b7-537e731a93cd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.821811 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1016/2047] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:26 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:26.825749 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909502b-dabf-4e3f-8dd9-1542e42aabb7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.835391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909502b-dabf-4e3f-8dd9-1542e42aabb7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.840126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3043d-1591-49ec-9c83-fa938f78bace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.840978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3043d-1591-49ec-9c83-fa938f78bace admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.841255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3043d-1591-49ec-9c83-fa938f78bace admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.841527 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3043d-1591-49ec-9c83-fa938f78bace admin admin] PATH_INFO: `/v3/projects/43025c4f7ec24b9f929d5362337a296d/users/2e70e8c84bac4f9ea7a3506f41ca5b3d/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.855507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3043d-1591-49ec-9c83-fa938f78bace admin admin] RBAC: Authorizing `identity:create_grant(project_id=43025c4f7ec24b9f929d5362337a296d, user_id=2e70e8c84bac4f9ea7a3506f41ca5b3d, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.858154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3043d-1591-49ec-9c83-fa938f78bace admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.870708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1032/2048] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:26 2022] PUT /identity/v3/projects/43025c4f7ec24b9f929d5362337a296d/users/2e70e8c84bac4f9ea7a3506f41ca5b3d/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:26.874492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd70c-3355-4bbd-99b7-537e731a93cd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.885409 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd70c-3355-4bbd-99b7-537e731a93cd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.940128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832dd62-badc-4703-98b9-6c7770a42afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.940805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832dd62-badc-4703-98b9-6c7770a42afd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.941086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832dd62-badc-4703-98b9-6c7770a42afd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.941362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832dd62-badc-4703-98b9-6c7770a42afd admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.942102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832dd62-badc-4703-98b9-6c7770a42afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.943722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832dd62-badc-4703-98b9-6c7770a42afd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.954598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1017/2049] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:26 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:26.959045 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3043d-1591-49ec-9c83-fa938f78bace admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:26.969566 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3043d-1591-49ec-9c83-fa938f78bace admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:26.974160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee441b40-b750-47fc-a090-b3db90ad569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:26.975084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441b40-b750-47fc-a090-b3db90ad569f admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:26.975369 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441b40-b750-47fc-a090-b3db90ad569f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:26.975644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441b40-b750-47fc-a090-b3db90ad569f admin admin] PATH_INFO: `/v3/projects/43025c4f7ec24b9f929d5362337a296d/users/2e70e8c84bac4f9ea7a3506f41ca5b3d/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:26.977755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee441b40-b750-47fc-a090-b3db90ad569f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43025c4f7ec24b9f929d5362337a296d, user_id=2e70e8c84bac4f9ea7a3506f41ca5b3d, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:26.980426 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee441b40-b750-47fc-a090-b3db90ad569f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:26.990464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1033/2050] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:26 2022] PUT /identity/v3/projects/43025c4f7ec24b9f929d5362337a296d/users/2e70e8c84bac4f9ea7a3506f41ca5b3d/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:27.001478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958d21-8053-4668-acf9-0415b0c73984 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:27.001761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958d21-8053-4668-acf9-0415b0c73984 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:27.002040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958d21-8053-4668-acf9-0415b0c73984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:27.029167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-56958d21-8053-4668-acf9-0415b0c73984 None None] MFA Rules not processed for user `2e70e8c84bac4f9ea7a3506f41ca5b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:27.030369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-56958d21-8053-4668-acf9-0415b0c73984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:27.098048 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1018/2051] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:27.108194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee441b40-b750-47fc-a090-b3db90ad569f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:27.109855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ee441b40-b750-47fc-a090-b3db90ad569f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:27.167167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee441b40-b750-47fc-a090-b3db90ad569f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:27.170817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d6c65-7bbc-4f96-b97c-763f4f870284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:27.171450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6c65-7bbc-4f96-b97c-763f4f870284 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:27.171733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6c65-7bbc-4f96-b97c-763f4f870284 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:27.172006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6c65-7bbc-4f96-b97c-763f4f870284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:27.181614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d6c65-7bbc-4f96-b97c-763f4f870284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:27.183061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d6c65-7bbc-4f96-b97c-763f4f870284 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:27.192344 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1034/2052] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:27.570266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56958d21-8053-4668-acf9-0415b0c73984 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:27.630695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56958d21-8053-4668-acf9-0415b0c73984 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:27.635626 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:27.636538 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:27.636941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:27.637227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] PATH_INFO: `/v3/users/4c38aff38bb04ba7a7d519bb6a951758` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:27.638438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c38aff38bb04ba7a7d519bb6a951758)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:27.640439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:27.691066 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c38aff38bb04ba7a7d519bb6a951758'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:27.697837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c38aff38bb04ba7a7d519bb6a951758'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:27.704420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c38aff38bb04ba7a7d519bb6a951758'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:27.716260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c38aff38bb04ba7a7d519bb6a951758'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:27.716896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c38aff38bb04ba7a7d519bb6a951758'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:27.722527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1019/2053] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:27 2022] DELETE /identity/v3/users/4c38aff38bb04ba7a7d519bb6a951758 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:27.727699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c9a7d-b665-48d2-a007-742347a37549 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:27.728197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c9a7d-b665-48d2-a007-742347a37549 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:27.728305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c9a7d-b665-48d2-a007-742347a37549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:27.746267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-318c9a7d-b665-48d2-a007-742347a37549 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:27.747409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-318c9a7d-b665-48d2-a007-742347a37549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:27.804306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1035/2054] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:27.813884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:27.815614 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:27.871096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f4e12-45a2-4f9c-b1f1-11b5bdaf782d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:27.874717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d00b0-7599-4b44-9d2f-6b5092387a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:27.875390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d00b0-7599-4b44-9d2f-6b5092387a35 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:27.875672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d00b0-7599-4b44-9d2f-6b5092387a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:27.875947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d00b0-7599-4b44-9d2f-6b5092387a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:27.885505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d00b0-7599-4b44-9d2f-6b5092387a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:27.886985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d00b0-7599-4b44-9d2f-6b5092387a35 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:27.896622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1020/2055] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:28.152127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c9a7d-b665-48d2-a007-742347a37549 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:28.153568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-318c9a7d-b665-48d2-a007-742347a37549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:28.166070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c9a7d-b665-48d2-a007-742347a37549 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:28.170809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:28.171663 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:28.171947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:28.172235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] PATH_INFO: `/v3/projects/188fc8bd60674256b8108660c124b642` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:28.173430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188fc8bd60674256b8108660c124b642)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:28.175393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:28.219949 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188fc8bd60674256b8108660c124b642', 'request_id': 'req-9255c04f-6694-46b8-bd77-80293b9b5fd8'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.225140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188fc8bd60674256b8108660c124b642', 'request_id': 'req-9255c04f-6694-46b8-bd77-80293b9b5fd8'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.232708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188fc8bd60674256b8108660c124b642', 'request_id': 'req-9255c04f-6694-46b8-bd77-80293b9b5fd8'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.244356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] The token cache is being invalidate because project 188fc8bd60674256b8108660c124b642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:28.244671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.245291 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.247255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1036/2056] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:28 2022] DELETE /identity/v3/projects/188fc8bd60674256b8108660c124b642 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:28.251203 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d00b0-7599-4b44-9d2f-6b5092387a35 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:28.260921 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d00b0-7599-4b44-9d2f-6b5092387a35 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:28.314335 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079483e1-fa46-468a-93f1-9a9b2add9da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:28.315497 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079483e1-fa46-468a-93f1-9a9b2add9da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:28.315777 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079483e1-fa46-468a-93f1-9a9b2add9da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:28.316050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079483e1-fa46-468a-93f1-9a9b2add9da3 admin admin] PATH_INFO: `/v3/users/2e70e8c84bac4f9ea7a3506f41ca5b3d` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:28.317258 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079483e1-fa46-468a-93f1-9a9b2add9da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e70e8c84bac4f9ea7a3506f41ca5b3d)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:28.319457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079483e1-fa46-468a-93f1-9a9b2add9da3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:28.364589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-079483e1-fa46-468a-93f1-9a9b2add9da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e70e8c84bac4f9ea7a3506f41ca5b3d'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.372748 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-079483e1-fa46-468a-93f1-9a9b2add9da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e70e8c84bac4f9ea7a3506f41ca5b3d'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.379401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-079483e1-fa46-468a-93f1-9a9b2add9da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e70e8c84bac4f9ea7a3506f41ca5b3d'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.390596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-079483e1-fa46-468a-93f1-9a9b2add9da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e70e8c84bac4f9ea7a3506f41ca5b3d'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.391265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-079483e1-fa46-468a-93f1-9a9b2add9da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e70e8c84bac4f9ea7a3506f41ca5b3d'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.396859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1021/2057] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:28 2022] DELETE /identity/v3/users/2e70e8c84bac4f9ea7a3506f41ca5b3d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:28.651614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:28.653383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:28.667241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255c04f-6694-46b8-bd77-80293b9b5fd8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:28.723929 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:28.724773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:28.725048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:28.725313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] PATH_INFO: `/v3/projects/43025c4f7ec24b9f929d5362337a296d` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:28.727175 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] RBAC: Authorizing `identity:delete_project(project_id=43025c4f7ec24b9f929d5362337a296d)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:28.729116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:28.773987 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43025c4f7ec24b9f929d5362337a296d', 'request_id': 'req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.779177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43025c4f7ec24b9f929d5362337a296d', 'request_id': 'req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.786304 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43025c4f7ec24b9f929d5362337a296d', 'request_id': 'req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.798131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] The token cache is being invalidate because project 43025c4f7ec24b9f929d5362337a296d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:28.798417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.799067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-7eaa2e31-11f3-4054-b9ea-fc846d7ddadd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:28.800607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1037/2058] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:28 2022] DELETE /identity/v3/projects/43025c4f7ec24b9f929d5362337a296d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:28.807844 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231fd1a-e3ba-4eea-9e4d-1047a8c1afb0 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:28.808682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231fd1a-e3ba-4eea-9e4d-1047a8c1afb0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:28.808965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231fd1a-e3ba-4eea-9e4d-1047a8c1afb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:28.827733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d231fd1a-e3ba-4eea-9e4d-1047a8c1afb0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:28.828983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d231fd1a-e3ba-4eea-9e4d-1047a8c1afb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:28.887238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1022/2059] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:28.894979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c16e27-2614-49db-94d1-83e6f299bb30 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:28.895269 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c16e27-2614-49db-94d1-83e6f299bb30 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:28.895571 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c16e27-2614-49db-94d1-83e6f299bb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:28.914181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-42c16e27-2614-49db-94d1-83e6f299bb30 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:28.915399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-42c16e27-2614-49db-94d1-83e6f299bb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:28.923146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1038/2060] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:28.927506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231fd1a-e3ba-4eea-9e4d-1047a8c1afb0 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:28.936912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231fd1a-e3ba-4eea-9e4d-1047a8c1afb0 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:28.941704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c826977-3ad4-46f7-b366-8152bc97e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:28.942341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c826977-3ad4-46f7-b366-8152bc97e320 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:28.942619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c826977-3ad4-46f7-b366-8152bc97e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:28.942929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c826977-3ad4-46f7-b366-8152bc97e320 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:28.943690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c826977-3ad4-46f7-b366-8152bc97e320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:28.943997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c826977-3ad4-46f7-b366-8152bc97e320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:28.946277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c826977-3ad4-46f7-b366-8152bc97e320 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:28.957558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1023/2061] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:51:28.962478 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c16e27-2614-49db-94d1-83e6f299bb30 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:28.971510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c16e27-2614-49db-94d1-83e6f299bb30 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:28.976417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946663a-e5e7-44be-9940-1100eeb75c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:28.977127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946663a-e5e7-44be-9940-1100eeb75c50 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:28.977410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946663a-e5e7-44be-9940-1100eeb75c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:28.977689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946663a-e5e7-44be-9940-1100eeb75c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:28.978423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946663a-e5e7-44be-9940-1100eeb75c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:28.980323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946663a-e5e7-44be-9940-1100eeb75c50 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:29.004999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1039/2062] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:28 2022] POST /identity/v3/projects => generated 364 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:29.009874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c826977-3ad4-46f7-b366-8152bc97e320 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:29.019533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c826977-3ad4-46f7-b366-8152bc97e320 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:29.078471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710acb88-1b09-47d6-83b7-a149b1b21283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:29.079274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710acb88-1b09-47d6-83b7-a149b1b21283 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:29.079499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710acb88-1b09-47d6-83b7-a149b1b21283 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:29.079774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710acb88-1b09-47d6-83b7-a149b1b21283 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:29.080522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710acb88-1b09-47d6-83b7-a149b1b21283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:29.082919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710acb88-1b09-47d6-83b7-a149b1b21283 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:29.102823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1024/2063] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:29 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:29.106863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946663a-e5e7-44be-9940-1100eeb75c50 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:29.117589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946663a-e5e7-44be-9940-1100eeb75c50 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:29.122388 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d7b7-6a64-4c7a-a867-53685772b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:29.123254 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d7b7-6a64-4c7a-a867-53685772b96b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:29.123603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d7b7-6a64-4c7a-a867-53685772b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:29.123963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d7b7-6a64-4c7a-a867-53685772b96b admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:29.124819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54d7b7-6a64-4c7a-a867-53685772b96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:29.126474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54d7b7-6a64-4c7a-a867-53685772b96b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:29.139005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1040/2064] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:29 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:29.142878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710acb88-1b09-47d6-83b7-a149b1b21283 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:29.164384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710acb88-1b09-47d6-83b7-a149b1b21283 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:29.170772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030c029-525f-4a0a-a399-a5b045ab5726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:29.171719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030c029-525f-4a0a-a399-a5b045ab5726 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:29.171719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030c029-525f-4a0a-a399-a5b045ab5726 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:29.171996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030c029-525f-4a0a-a399-a5b045ab5726 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:29.172911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030c029-525f-4a0a-a399-a5b045ab5726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:29.174532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030c029-525f-4a0a-a399-a5b045ab5726 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:29.191132 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d7b7-6a64-4c7a-a867-53685772b96b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:29.199090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1025/2065] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:29 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:29.204854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d7b7-6a64-4c7a-a867-53685772b96b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:29.211431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a76ed-b045-48fb-a74c-75e07c5adbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:29.212479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a76ed-b045-48fb-a74c-75e07c5adbb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:29.212767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a76ed-b045-48fb-a74c-75e07c5adbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:29.213046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a76ed-b045-48fb-a74c-75e07c5adbb1 admin admin] PATH_INFO: `/v3/projects/1f4225946c604cf883be3773d3cac2c9/users/a6b23a71c07b44a9a68748815dbee5bd/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:29.235041 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a76ed-b045-48fb-a74c-75e07c5adbb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4225946c604cf883be3773d3cac2c9, user_id=a6b23a71c07b44a9a68748815dbee5bd, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:29.238586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a76ed-b045-48fb-a74c-75e07c5adbb1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:29.258722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1041/2066] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:29 2022] PUT /identity/v3/projects/1f4225946c604cf883be3773d3cac2c9/users/a6b23a71c07b44a9a68748815dbee5bd/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:29.269832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea98b-11d7-4377-a6fe-e751a4036231 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:29.270129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea98b-11d7-4377-a6fe-e751a4036231 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:29.270414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea98b-11d7-4377-a6fe-e751a4036231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:29.323390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-157ea98b-11d7-4377-a6fe-e751a4036231 None None] MFA Rules not processed for user `a6b23a71c07b44a9a68748815dbee5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:29.324644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-157ea98b-11d7-4377-a6fe-e751a4036231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:29.411105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1026/2067] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:29.422194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a76ed-b045-48fb-a74c-75e07c5adbb1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:29.424401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-365a76ed-b045-48fb-a74c-75e07c5adbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:29.534686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a76ed-b045-48fb-a74c-75e07c5adbb1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:29.541008 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e5e07-41d7-47a3-91b6-3e0368353e81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:29.541664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e5e07-41d7-47a3-91b6-3e0368353e81 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:29.542512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e5e07-41d7-47a3-91b6-3e0368353e81 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:29.542632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e5e07-41d7-47a3-91b6-3e0368353e81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:29.561981 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e5e07-41d7-47a3-91b6-3e0368353e81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:29.564057 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e5e07-41d7-47a3-91b6-3e0368353e81 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:29.574633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1042/2068] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:29.888977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea98b-11d7-4377-a6fe-e751a4036231 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:29.899503 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-157ea98b-11d7-4377-a6fe-e751a4036231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:29.995485 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea98b-11d7-4377-a6fe-e751a4036231 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:30.003481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:30.005016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:30.006074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:30.006695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] PATH_INFO: `/v3/users/a72f906646a34160b17eaa984a98d305` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:30.009048 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72f906646a34160b17eaa984a98d305)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:30.012115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:30.061968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72f906646a34160b17eaa984a98d305'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:30.070550 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72f906646a34160b17eaa984a98d305'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:30.077465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72f906646a34160b17eaa984a98d305'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:30.089264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72f906646a34160b17eaa984a98d305'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:30.090018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72f906646a34160b17eaa984a98d305'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:30.095831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1027/2069] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:29 2022] DELETE /identity/v3/users/a72f906646a34160b17eaa984a98d305 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:30.100367 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a50631-98f5-48ce-906a-794f3fd001ac None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:30.101085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a50631-98f5-48ce-906a-794f3fd001ac None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:30.101085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a50631-98f5-48ce-906a-794f3fd001ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:30.119244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-26a50631-98f5-48ce-906a-794f3fd001ac None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:30.120470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-26a50631-98f5-48ce-906a-794f3fd001ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:30.197397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1043/2070] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:30.206855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:30.208334 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:30.265424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ca2e1-0a79-4688-bd57-2890b62bda7e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:30.269162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e01f-0a10-495d-9d43-8f1a08d0bbf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:30.269792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e01f-0a10-495d-9d43-8f1a08d0bbf4 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:30.270210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e01f-0a10-495d-9d43-8f1a08d0bbf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:30.270512 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e01f-0a10-495d-9d43-8f1a08d0bbf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:30.279878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e01f-0a10-495d-9d43-8f1a08d0bbf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:30.281365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e01f-0a10-495d-9d43-8f1a08d0bbf4 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:30.292673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1028/2071] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:30.780402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a50631-98f5-48ce-906a-794f3fd001ac None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:30.782016 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-26a50631-98f5-48ce-906a-794f3fd001ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:30.801165 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a50631-98f5-48ce-906a-794f3fd001ac None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:30.806452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:30.807553 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:30.807988 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:30.808398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] PATH_INFO: `/v3/projects/1ea58f0b4e034c5cad4447de3d5ad02b` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:30.809732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea58f0b4e034c5cad4447de3d5ad02b)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:30.811846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:30.868558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea58f0b4e034c5cad4447de3d5ad02b', 'request_id': 'req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:30.873972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea58f0b4e034c5cad4447de3d5ad02b', 'request_id': 'req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:30.881294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea58f0b4e034c5cad4447de3d5ad02b', 'request_id': 'req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:30.893192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] The token cache is being invalidate because project 1ea58f0b4e034c5cad4447de3d5ad02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:30.893476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:30.894122 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:30.896260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1044/2072] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:30 2022] DELETE /identity/v3/projects/1ea58f0b4e034c5cad4447de3d5ad02b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:30.900688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e01f-0a10-495d-9d43-8f1a08d0bbf4 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:30.910463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e01f-0a10-495d-9d43-8f1a08d0bbf4 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:30.968010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79b5a8-edf7-4b22-abf5-6aca33a0e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:30.968868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79b5a8-edf7-4b22-abf5-6aca33a0e789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:30.969142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79b5a8-edf7-4b22-abf5-6aca33a0e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:30.969410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79b5a8-edf7-4b22-abf5-6aca33a0e789 admin admin] PATH_INFO: `/v3/users/306bc64488ab492b990eb9dce68927d6` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:30.970603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79b5a8-edf7-4b22-abf5-6aca33a0e789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=306bc64488ab492b990eb9dce68927d6)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:30.972589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79b5a8-edf7-4b22-abf5-6aca33a0e789 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:31.031107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6d79b5a8-edf7-4b22-abf5-6aca33a0e789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306bc64488ab492b990eb9dce68927d6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:31.040391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6d79b5a8-edf7-4b22-abf5-6aca33a0e789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306bc64488ab492b990eb9dce68927d6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:31.048229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6d79b5a8-edf7-4b22-abf5-6aca33a0e789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306bc64488ab492b990eb9dce68927d6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:31.061567 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6d79b5a8-edf7-4b22-abf5-6aca33a0e789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306bc64488ab492b990eb9dce68927d6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:31.062203 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6d79b5a8-edf7-4b22-abf5-6aca33a0e789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306bc64488ab492b990eb9dce68927d6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:31.071800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1029/2073] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:30 2022] DELETE /identity/v3/users/306bc64488ab492b990eb9dce68927d6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:31.496681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:31.498350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:31.524796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1396b8-3bdf-4c4d-8089-22d7c58b1c37 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:31.597268 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:31.598137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:31.598421 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:31.599418 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] PATH_INFO: `/v3/projects/22786afd373c420eb2c9e2743e41e606` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:31.601220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22786afd373c420eb2c9e2743e41e606)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:31.603378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:31.664206 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22786afd373c420eb2c9e2743e41e606', 'request_id': 'req-e4babdec-2887-4981-b747-ad95081bd81a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:31.671801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22786afd373c420eb2c9e2743e41e606', 'request_id': 'req-e4babdec-2887-4981-b747-ad95081bd81a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:31.682199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22786afd373c420eb2c9e2743e41e606', 'request_id': 'req-e4babdec-2887-4981-b747-ad95081bd81a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:31.697636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] The token cache is being invalidate because project 22786afd373c420eb2c9e2743e41e606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:31.697958 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:31.698617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e4babdec-2887-4981-b747-ad95081bd81a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:31.700312 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1045/2074] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:31 2022] DELETE /identity/v3/projects/22786afd373c420eb2c9e2743e41e606 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:31.706274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e798880-b971-43c3-9a22-b362f1001c33 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:31.706789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e798880-b971-43c3-9a22-b362f1001c33 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:31.707362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e798880-b971-43c3-9a22-b362f1001c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:31.740366 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-6e798880-b971-43c3-9a22-b362f1001c33 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:31.742172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-6e798880-b971-43c3-9a22-b362f1001c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:31.832660 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1030/2075] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:31.842454 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821914-1658-47af-b7e0-cbca4565a98b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:31.842852 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821914-1658-47af-b7e0-cbca4565a98b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:31.843204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821914-1658-47af-b7e0-cbca4565a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:31.882134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-7b821914-1658-47af-b7e0-cbca4565a98b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:31.884593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7b821914-1658-47af-b7e0-cbca4565a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:31.899939 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1046/2076] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:31.903797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e798880-b971-43c3-9a22-b362f1001c33 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:31.921786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e798880-b971-43c3-9a22-b362f1001c33 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:31.926883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b4c0f-3f70-4dab-94e6-7a02590abab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:31.927545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b4c0f-3f70-4dab-94e6-7a02590abab1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:31.927825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b4c0f-3f70-4dab-94e6-7a02590abab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:31.928099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b4c0f-3f70-4dab-94e6-7a02590abab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:31.929646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b4c0f-3f70-4dab-94e6-7a02590abab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:31.929955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b4c0f-3f70-4dab-94e6-7a02590abab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:31.932026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b4c0f-3f70-4dab-94e6-7a02590abab1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:31.947198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1031/2077] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:51:31.951569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b821914-1658-47af-b7e0-cbca4565a98b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:31.965072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b821914-1658-47af-b7e0-cbca4565a98b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:31.970673 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c10792-95f0-41dc-8d04-baf047947f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:31.971589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c10792-95f0-41dc-8d04-baf047947f27 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:31.972123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c10792-95f0-41dc-8d04-baf047947f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:31.972736 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c10792-95f0-41dc-8d04-baf047947f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:31.973840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c10792-95f0-41dc-8d04-baf047947f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:31.976997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c10792-95f0-41dc-8d04-baf047947f27 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:32.015522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1047/2078] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:31 2022] POST /identity/v3/projects => generated 390 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:32.020156 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b4c0f-3f70-4dab-94e6-7a02590abab1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:32.047485 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b4c0f-3f70-4dab-94e6-7a02590abab1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:32.172234 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5829b-a715-4982-b92c-7a157adc65c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:32.173129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5829b-a715-4982-b92c-7a157adc65c2 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.173616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5829b-a715-4982-b92c-7a157adc65c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.173897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5829b-a715-4982-b92c-7a157adc65c2 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.174786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5829b-a715-4982-b92c-7a157adc65c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:32.177562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5829b-a715-4982-b92c-7a157adc65c2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:32.205692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1032/2079] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:32 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:32.207145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c10792-95f0-41dc-8d04-baf047947f27 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:32.219007 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c10792-95f0-41dc-8d04-baf047947f27 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:32.224103 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce400037-419a-4290-a8f0-adb59e62d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:32.224860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce400037-419a-4290-a8f0-adb59e62d19a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.225236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce400037-419a-4290-a8f0-adb59e62d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.225723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce400037-419a-4290-a8f0-adb59e62d19a admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.227095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce400037-419a-4290-a8f0-adb59e62d19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:32.228989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce400037-419a-4290-a8f0-adb59e62d19a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:32.239723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1048/2080] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:32 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:32.244330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5829b-a715-4982-b92c-7a157adc65c2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:32.254467 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5829b-a715-4982-b92c-7a157adc65c2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:32.259841 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c2543-be4c-45a5-95f7-482240954cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:32.260471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2543-be4c-45a5-95f7-482240954cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.260752 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2543-be4c-45a5-95f7-482240954cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.261025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2543-be4c-45a5-95f7-482240954cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.261756 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c2543-be4c-45a5-95f7-482240954cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:32.263401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c2543-be4c-45a5-95f7-482240954cb4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:32.273304 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1033/2081] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:32 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:32.278133 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce400037-419a-4290-a8f0-adb59e62d19a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:32.289951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce400037-419a-4290-a8f0-adb59e62d19a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:32.295236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76536944-fe57-4611-b71b-92368f7dad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:32.296315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76536944-fe57-4611-b71b-92368f7dad2b admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.296634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76536944-fe57-4611-b71b-92368f7dad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.296956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76536944-fe57-4611-b71b-92368f7dad2b admin admin] PATH_INFO: `/v3/projects/9ddc2f481b364adab4b4b64e35dba440/users/b22262370660401481be39b670566b9c/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.312000 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76536944-fe57-4611-b71b-92368f7dad2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddc2f481b364adab4b4b64e35dba440, user_id=b22262370660401481be39b670566b9c, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:32.314926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76536944-fe57-4611-b71b-92368f7dad2b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:32.328188 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1049/2082] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:32 2022] PUT /identity/v3/projects/9ddc2f481b364adab4b4b64e35dba440/users/b22262370660401481be39b670566b9c/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:32.338799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcab96-be82-4600-8849-99e3111624eb None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.339069 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcab96-be82-4600-8849-99e3111624eb None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.339344 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcab96-be82-4600-8849-99e3111624eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.365127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-94bcab96-be82-4600-8849-99e3111624eb None None] MFA Rules not processed for user `b22262370660401481be39b670566b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:32.367379 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-94bcab96-be82-4600-8849-99e3111624eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:32.431255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1034/2083] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:32.435905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76536944-fe57-4611-b71b-92368f7dad2b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:32.509452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76536944-fe57-4611-b71b-92368f7dad2b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:32.517119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35f524-9474-4364-a474-4e78c093accb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:32.518029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f524-9474-4364-a474-4e78c093accb admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.518385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f524-9474-4364-a474-4e78c093accb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.518729 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f524-9474-4364-a474-4e78c093accb admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.519543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35f524-9474-4364-a474-4e78c093accb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:32.521704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35f524-9474-4364-a474-4e78c093accb admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:32.568218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1050/2084] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:32 2022] POST /identity/v3/projects => generated 390 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:32.569805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcab96-be82-4600-8849-99e3111624eb None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:32.580956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcab96-be82-4600-8849-99e3111624eb None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:32.640735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71df0c-8d51-40af-b4ad-c43f34577f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:32.641491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71df0c-8d51-40af-b4ad-c43f34577f35 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.641849 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71df0c-8d51-40af-b4ad-c43f34577f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.642253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71df0c-8d51-40af-b4ad-c43f34577f35 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.643040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71df0c-8d51-40af-b4ad-c43f34577f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:32.645146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71df0c-8d51-40af-b4ad-c43f34577f35 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:32.675985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1035/2085] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:32 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:32.677225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35f524-9474-4364-a474-4e78c093accb admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:32.690274 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35f524-9474-4364-a474-4e78c093accb admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:32.698231 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35318dc-d55c-4d45-b01d-b963f8bf0c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:32.698962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35318dc-d55c-4d45-b01d-b963f8bf0c3e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.699273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35318dc-d55c-4d45-b01d-b963f8bf0c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.699550 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35318dc-d55c-4d45-b01d-b963f8bf0c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.700450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35318dc-d55c-4d45-b01d-b963f8bf0c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:32.702305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35318dc-d55c-4d45-b01d-b963f8bf0c3e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:32.718830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1051/2086] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:32 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:32.721339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71df0c-8d51-40af-b4ad-c43f34577f35 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:32.733862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71df0c-8d51-40af-b4ad-c43f34577f35 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:32.738702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f938-7f53-4473-99de-a367274b1ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:32.739656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f938-7f53-4473-99de-a367274b1ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.739945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f938-7f53-4473-99de-a367274b1ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.740220 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f938-7f53-4473-99de-a367274b1ef3 admin admin] PATH_INFO: `/v3/projects/ca1bc6e891604d76bb5400ec0b50f536/users/65c8df36f7384ca7ac5e5882bc9d858d/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.756069 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18f938-7f53-4473-99de-a367274b1ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1bc6e891604d76bb5400ec0b50f536, user_id=65c8df36f7384ca7ac5e5882bc9d858d, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:32.759421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18f938-7f53-4473-99de-a367274b1ef3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:32.775767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1036/2087] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:32 2022] PUT /identity/v3/projects/ca1bc6e891604d76bb5400ec0b50f536/users/65c8df36f7384ca7ac5e5882bc9d858d/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:32.779774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35318dc-d55c-4d45-b01d-b963f8bf0c3e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:32.790532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35318dc-d55c-4d45-b01d-b963f8bf0c3e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:32.852615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422e186-feab-443e-95ca-1d4049a98ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:32.853288 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e186-feab-443e-95ca-1d4049a98ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.853569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e186-feab-443e-95ca-1d4049a98ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.853845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e186-feab-443e-95ca-1d4049a98ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.854718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422e186-feab-443e-95ca-1d4049a98ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:32.856504 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422e186-feab-443e-95ca-1d4049a98ed2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:32.874397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1052/2088] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:32 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:32.874617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f938-7f53-4473-99de-a367274b1ef3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:32.881077 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f938-7f53-4473-99de-a367274b1ef3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:32.886043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9399d-f635-4208-b6fe-7aa6aa38ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:32.887030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9399d-f635-4208-b6fe-7aa6aa38ad50 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.887322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9399d-f635-4208-b6fe-7aa6aa38ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.887598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9399d-f635-4208-b6fe-7aa6aa38ad50 admin admin] PATH_INFO: `/v3/projects/ca1bc6e891604d76bb5400ec0b50f536/users/65c8df36f7384ca7ac5e5882bc9d858d/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.894802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9399d-f635-4208-b6fe-7aa6aa38ad50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1bc6e891604d76bb5400ec0b50f536, user_id=65c8df36f7384ca7ac5e5882bc9d858d, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:32.898225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9399d-f635-4208-b6fe-7aa6aa38ad50 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:32.911506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1037/2089] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:32 2022] PUT /identity/v3/projects/ca1bc6e891604d76bb5400ec0b50f536/users/65c8df36f7384ca7ac5e5882bc9d858d/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:51:32.922710 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f17edd-7e91-49b4-b633-8e4b7bdeaa1f None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:32.923026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f17edd-7e91-49b4-b633-8e4b7bdeaa1f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:32.923303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f17edd-7e91-49b4-b633-8e4b7bdeaa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:32.955065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-91f17edd-7e91-49b4-b633-8e4b7bdeaa1f None None] MFA Rules not processed for user `65c8df36f7384ca7ac5e5882bc9d858d`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:32.956769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-91f17edd-7e91-49b4-b633-8e4b7bdeaa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:33.058436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1053/2090] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:33.068909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9399d-f635-4208-b6fe-7aa6aa38ad50 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:33.073313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a3e9399d-f635-4208-b6fe-7aa6aa38ad50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:33.170070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9399d-f635-4208-b6fe-7aa6aa38ad50 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:33.175584 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bfaca-b014-4ca8-9cd7-c89b43ddc5f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:33.177028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfaca-b014-4ca8-9cd7-c89b43ddc5f2 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:33.177563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfaca-b014-4ca8-9cd7-c89b43ddc5f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:33.179446 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfaca-b014-4ca8-9cd7-c89b43ddc5f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:33.197743 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bfaca-b014-4ca8-9cd7-c89b43ddc5f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:33.200300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bfaca-b014-4ca8-9cd7-c89b43ddc5f2 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:33.229057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1038/2091] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:33.361868 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f17edd-7e91-49b4-b633-8e4b7bdeaa1f None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:33.426874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f17edd-7e91-49b4-b633-8e4b7bdeaa1f None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:33.432447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:33.433302 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:33.433586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:33.433861 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] PATH_INFO: `/v3/users/b22262370660401481be39b670566b9c` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:33.435123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b22262370660401481be39b670566b9c)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:33.437051 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:33.482067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b22262370660401481be39b670566b9c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:33.494567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b22262370660401481be39b670566b9c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:33.495269 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b22262370660401481be39b670566b9c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:33.495874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b22262370660401481be39b670566b9c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:33.502930 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b22262370660401481be39b670566b9c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:33.515093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1054/2092] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:33 2022] DELETE /identity/v3/users/b22262370660401481be39b670566b9c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:33.519739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318d51-553c-4cc2-9e28-ffb1d4bb1975 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:33.520026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318d51-553c-4cc2-9e28-ffb1d4bb1975 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:33.520306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318d51-553c-4cc2-9e28-ffb1d4bb1975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:33.539470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-dd318d51-553c-4cc2-9e28-ffb1d4bb1975 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:33.540668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dd318d51-553c-4cc2-9e28-ffb1d4bb1975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:33.608063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1039/2093] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:33.618356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:33.619827 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:33.676665 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398d0d8-cd7d-4a8d-a59b-35447ef829a8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:33.680466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ae752-1172-4f80-bc9a-8bfff422d7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:33.681117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ae752-1172-4f80-bc9a-8bfff422d7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:33.681398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ae752-1172-4f80-bc9a-8bfff422d7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:33.681678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ae752-1172-4f80-bc9a-8bfff422d7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:33.692137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ae752-1172-4f80-bc9a-8bfff422d7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:33.694972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ae752-1172-4f80-bc9a-8bfff422d7b5 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:33.705163 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1055/2094] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:33.977182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd318d51-553c-4cc2-9e28-ffb1d4bb1975 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:33.978719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dd318d51-553c-4cc2-9e28-ffb1d4bb1975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:33.990517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd318d51-553c-4cc2-9e28-ffb1d4bb1975 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:33.996272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:33.997131 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:33.997414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:33.997693 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] PATH_INFO: `/v3/projects/9ddc2f481b364adab4b4b64e35dba440` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:33.999657 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ddc2f481b364adab4b4b64e35dba440)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:34.001586 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:34.048148 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ddc2f481b364adab4b4b64e35dba440', 'request_id': 'req-89c7c0f7-ff7b-4d47-9cae-b931607e0513'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.055232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ddc2f481b364adab4b4b64e35dba440', 'request_id': 'req-89c7c0f7-ff7b-4d47-9cae-b931607e0513'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.061427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ddc2f481b364adab4b4b64e35dba440', 'request_id': 'req-89c7c0f7-ff7b-4d47-9cae-b931607e0513'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.072217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] The token cache is being invalidate because project 9ddc2f481b364adab4b4b64e35dba440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:34.072506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.073142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.074675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1040/2095] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:33 2022] DELETE /identity/v3/projects/9ddc2f481b364adab4b4b64e35dba440 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:34.078579 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ae752-1172-4f80-bc9a-8bfff422d7b5 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:34.088747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ae752-1172-4f80-bc9a-8bfff422d7b5 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:34.144839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dac74-305c-4ae5-a2bb-83490f88ebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:34.145699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dac74-305c-4ae5-a2bb-83490f88ebe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:34.145980 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dac74-305c-4ae5-a2bb-83490f88ebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:34.146255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dac74-305c-4ae5-a2bb-83490f88ebe5 admin admin] PATH_INFO: `/v3/users/65c8df36f7384ca7ac5e5882bc9d858d` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:34.148709 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dac74-305c-4ae5-a2bb-83490f88ebe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c8df36f7384ca7ac5e5882bc9d858d)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:34.150616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dac74-305c-4ae5-a2bb-83490f88ebe5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:34.198313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f73dac74-305c-4ae5-a2bb-83490f88ebe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c8df36f7384ca7ac5e5882bc9d858d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.210978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f73dac74-305c-4ae5-a2bb-83490f88ebe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c8df36f7384ca7ac5e5882bc9d858d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.211769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f73dac74-305c-4ae5-a2bb-83490f88ebe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c8df36f7384ca7ac5e5882bc9d858d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.212438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f73dac74-305c-4ae5-a2bb-83490f88ebe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c8df36f7384ca7ac5e5882bc9d858d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.219962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f73dac74-305c-4ae5-a2bb-83490f88ebe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c8df36f7384ca7ac5e5882bc9d858d'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.232416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1056/2096] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:34 2022] DELETE /identity/v3/users/65c8df36f7384ca7ac5e5882bc9d858d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:34.563606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:34.565563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:34.579295 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c0f7-ff7b-4d47-9cae-b931607e0513 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:34.646312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:34.647689 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:34.647994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:34.648272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] PATH_INFO: `/v3/projects/ca1bc6e891604d76bb5400ec0b50f536` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:34.649472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1bc6e891604d76bb5400ec0b50f536)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:34.651437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:34.696449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1bc6e891604d76bb5400ec0b50f536', 'request_id': 'req-e8222611-a6ba-4000-86c7-9031153f7bf1'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.703285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1bc6e891604d76bb5400ec0b50f536', 'request_id': 'req-e8222611-a6ba-4000-86c7-9031153f7bf1'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.709187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1bc6e891604d76bb5400ec0b50f536', 'request_id': 'req-e8222611-a6ba-4000-86c7-9031153f7bf1'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.718826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] The token cache is being invalidate because project ca1bc6e891604d76bb5400ec0b50f536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:34.719112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.719725 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e8222611-a6ba-4000-86c7-9031153f7bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:34.721255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1041/2097] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:34 2022] DELETE /identity/v3/projects/ca1bc6e891604d76bb5400ec0b50f536 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:51:34.727406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4fef-cf12-43e9-a0cb-cedad5722188 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:34.727865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4fef-cf12-43e9-a0cb-cedad5722188 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:34.727954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4fef-cf12-43e9-a0cb-cedad5722188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:34.746166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d69d4fef-cf12-43e9-a0cb-cedad5722188 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:34.747387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d69d4fef-cf12-43e9-a0cb-cedad5722188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:34.807163 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1057/2098] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:34.815265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cca65-4304-46ac-89cb-22b6d471fffc None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:34.815553 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cca65-4304-46ac-89cb-22b6d471fffc None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:34.815839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cca65-4304-46ac-89cb-22b6d471fffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:34.834395 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a27cca65-4304-46ac-89cb-22b6d471fffc None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:34.836154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a27cca65-4304-46ac-89cb-22b6d471fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:34.844061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1042/2099] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:34.848266 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d4fef-cf12-43e9-a0cb-cedad5722188 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:34.858340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d4fef-cf12-43e9-a0cb-cedad5722188 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:34.863116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63f5c0-4c7a-4764-94d9-898654f7b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:34.863794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f5c0-4c7a-4764-94d9-898654f7b667 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:34.864074 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f5c0-4c7a-4764-94d9-898654f7b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:34.864351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f5c0-4c7a-4764-94d9-898654f7b667 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:34.865090 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63f5c0-4c7a-4764-94d9-898654f7b667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:34.865401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63f5c0-4c7a-4764-94d9-898654f7b667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:34.867229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63f5c0-4c7a-4764-94d9-898654f7b667 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:34.878531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1058/2100] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:51:34.883513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cca65-4304-46ac-89cb-22b6d471fffc None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:34.892493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cca65-4304-46ac-89cb-22b6d471fffc None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:34.898101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429c0cb-956b-4f0f-8677-5576e3b3cb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:34.898523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429c0cb-956b-4f0f-8677-5576e3b3cb08 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:34.898852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429c0cb-956b-4f0f-8677-5576e3b3cb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:34.899135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429c0cb-956b-4f0f-8677-5576e3b3cb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:34.899838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429c0cb-956b-4f0f-8677-5576e3b3cb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:34.902020 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429c0cb-956b-4f0f-8677-5576e3b3cb08 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:34.931346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1043/2101] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:34 2022] POST /identity/v3/projects => generated 410 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:34.932617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63f5c0-4c7a-4764-94d9-898654f7b667 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:34.942731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63f5c0-4c7a-4764-94d9-898654f7b667 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:34.998567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af3241-35ad-4add-92c1-0b75ea77a640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:34.999258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af3241-35ad-4add-92c1-0b75ea77a640 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:34.999539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af3241-35ad-4add-92c1-0b75ea77a640 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:34.999812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af3241-35ad-4add-92c1-0b75ea77a640 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.000506 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af3241-35ad-4add-92c1-0b75ea77a640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:35.002402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af3241-35ad-4add-92c1-0b75ea77a640 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:35.021982 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1059/2102] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:34 2022] POST /identity/v3/users => generated 306 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:35.026800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429c0cb-956b-4f0f-8677-5576e3b3cb08 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:35.036847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429c0cb-956b-4f0f-8677-5576e3b3cb08 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:35.041780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097c739-89f3-439f-9719-cd7ee5930671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:35.042424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097c739-89f3-439f-9719-cd7ee5930671 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.042709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097c739-89f3-439f-9719-cd7ee5930671 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.043019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097c739-89f3-439f-9719-cd7ee5930671 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.043795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097c739-89f3-439f-9719-cd7ee5930671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:35.045424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097c739-89f3-439f-9719-cd7ee5930671 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:35.056305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1044/2103] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:35 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:51:35.060142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af3241-35ad-4add-92c1-0b75ea77a640 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:35.070636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af3241-35ad-4add-92c1-0b75ea77a640 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:35.075218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a888ecb-6dd2-4f36-a54b-012c57ab6d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:35.075848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a888ecb-6dd2-4f36-a54b-012c57ab6d1f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.076127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a888ecb-6dd2-4f36-a54b-012c57ab6d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.076401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a888ecb-6dd2-4f36-a54b-012c57ab6d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.077126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a888ecb-6dd2-4f36-a54b-012c57ab6d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:35.078687 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a888ecb-6dd2-4f36-a54b-012c57ab6d1f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:35.088517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1060/2104] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:35 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:35.092472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097c739-89f3-439f-9719-cd7ee5930671 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:35.102511 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097c739-89f3-439f-9719-cd7ee5930671 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:35.107096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5778a-b7e5-4a84-a5ce-29aba373418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:35.107949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5778a-b7e5-4a84-a5ce-29aba373418c admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.108227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5778a-b7e5-4a84-a5ce-29aba373418c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.108501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5778a-b7e5-4a84-a5ce-29aba373418c admin admin] PATH_INFO: `/v3/projects/fd5ee388a3b1403eafd6d30965c5bfbb/users/c0bb840c481641c78b8c64fb4ab4c680/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.123245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5778a-b7e5-4a84-a5ce-29aba373418c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5ee388a3b1403eafd6d30965c5bfbb, user_id=c0bb840c481641c78b8c64fb4ab4c680, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:35.125861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5778a-b7e5-4a84-a5ce-29aba373418c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:35.139025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1045/2105] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:35 2022] PUT /identity/v3/projects/fd5ee388a3b1403eafd6d30965c5bfbb/users/c0bb840c481641c78b8c64fb4ab4c680/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:35.149634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ccd3-e3a6-4a2b-a972-7409d9201eab None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.149920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ccd3-e3a6-4a2b-a972-7409d9201eab None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.150226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ccd3-e3a6-4a2b-a972-7409d9201eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.177514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-eda7ccd3-e3a6-4a2b-a972-7409d9201eab None None] MFA Rules not processed for user `c0bb840c481641c78b8c64fb4ab4c680`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:35.178887 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-eda7ccd3-e3a6-4a2b-a972-7409d9201eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:35.239611 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1061/2106] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:35 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:35.244158 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5778a-b7e5-4a84-a5ce-29aba373418c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:35.305090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5778a-b7e5-4a84-a5ce-29aba373418c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:35.309651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1efd7-9efa-44fb-b5f9-153cb15fe6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:35.310289 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1efd7-9efa-44fb-b5f9-153cb15fe6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.310565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1efd7-9efa-44fb-b5f9-153cb15fe6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.310866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1efd7-9efa-44fb-b5f9-153cb15fe6c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.311569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1efd7-9efa-44fb-b5f9-153cb15fe6c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:35.313436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1efd7-9efa-44fb-b5f9-153cb15fe6c6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:35.338606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1046/2107] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:35 2022] POST /identity/v3/projects => generated 410 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:35.342464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7ccd3-e3a6-4a2b-a972-7409d9201eab None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:35.353789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7ccd3-e3a6-4a2b-a972-7409d9201eab None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:35.411049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f76d4-b977-4366-bb64-08042f200cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:35.411731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f76d4-b977-4366-bb64-08042f200cdb admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.412015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f76d4-b977-4366-bb64-08042f200cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.412289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f76d4-b977-4366-bb64-08042f200cdb admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.413409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f76d4-b977-4366-bb64-08042f200cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:35.415176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f76d4-b977-4366-bb64-08042f200cdb admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:35.435491 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1062/2108] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:35 2022] POST /identity/v3/users => generated 312 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:35.439825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1efd7-9efa-44fb-b5f9-153cb15fe6c6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:35.451705 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1efd7-9efa-44fb-b5f9-153cb15fe6c6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:35.456518 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186b271-0f68-40a0-af26-a17e30bb1067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:35.457182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186b271-0f68-40a0-af26-a17e30bb1067 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.457489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186b271-0f68-40a0-af26-a17e30bb1067 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.457770 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186b271-0f68-40a0-af26-a17e30bb1067 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.458548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186b271-0f68-40a0-af26-a17e30bb1067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:35.461009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186b271-0f68-40a0-af26-a17e30bb1067 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:35.471486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1047/2109] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:35 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:35.475651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f76d4-b977-4366-bb64-08042f200cdb admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:35.485530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f76d4-b977-4366-bb64-08042f200cdb admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:35.490172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47f76b-ab7e-4aab-bd46-6e799728c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:35.491626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47f76b-ab7e-4aab-bd46-6e799728c36f admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.491911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47f76b-ab7e-4aab-bd46-6e799728c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.492189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47f76b-ab7e-4aab-bd46-6e799728c36f admin admin] PATH_INFO: `/v3/projects/26129d8b2de74beb88363328b7725413/users/310f3ab3b54b49eab58123ef55332c01/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.508804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47f76b-ab7e-4aab-bd46-6e799728c36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26129d8b2de74beb88363328b7725413, user_id=310f3ab3b54b49eab58123ef55332c01, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:35.511463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47f76b-ab7e-4aab-bd46-6e799728c36f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:35.524540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1063/2110] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:35 2022] PUT /identity/v3/projects/26129d8b2de74beb88363328b7725413/users/310f3ab3b54b49eab58123ef55332c01/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:35.528510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186b271-0f68-40a0-af26-a17e30bb1067 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:35.538461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186b271-0f68-40a0-af26-a17e30bb1067 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:35.595114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310c1b5-9be6-4e75-9845-36314248bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:35.595973 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310c1b5-9be6-4e75-9845-36314248bf65 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.596267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310c1b5-9be6-4e75-9845-36314248bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.596548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310c1b5-9be6-4e75-9845-36314248bf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.597303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310c1b5-9be6-4e75-9845-36314248bf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:35.598969 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310c1b5-9be6-4e75-9845-36314248bf65 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:35.609549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1048/2111] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:35 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:35.613653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47f76b-ab7e-4aab-bd46-6e799728c36f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:35.624417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47f76b-ab7e-4aab-bd46-6e799728c36f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:35.628975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157f4b-4cf5-422a-af91-9b09c5ceeca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:35.629839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157f4b-4cf5-422a-af91-9b09c5ceeca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.630117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157f4b-4cf5-422a-af91-9b09c5ceeca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.630390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157f4b-4cf5-422a-af91-9b09c5ceeca8 admin admin] PATH_INFO: `/v3/projects/26129d8b2de74beb88363328b7725413/users/310f3ab3b54b49eab58123ef55332c01/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.633495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce157f4b-4cf5-422a-af91-9b09c5ceeca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26129d8b2de74beb88363328b7725413, user_id=310f3ab3b54b49eab58123ef55332c01, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:35.636156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce157f4b-4cf5-422a-af91-9b09c5ceeca8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:35.648687 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1064/2112] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:35 2022] PUT /identity/v3/projects/26129d8b2de74beb88363328b7725413/users/310f3ab3b54b49eab58123ef55332c01/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:35.659594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d895-6ef0-4d57-82a2-ffcc41959330 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.659905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d895-6ef0-4d57-82a2-ffcc41959330 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.660183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d895-6ef0-4d57-82a2-ffcc41959330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.686411 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-6c52d895-6ef0-4d57-82a2-ffcc41959330 None None] MFA Rules not processed for user `310f3ab3b54b49eab58123ef55332c01`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:35.687674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-6c52d895-6ef0-4d57-82a2-ffcc41959330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:35.755381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1049/2113] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:35 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:35.765398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157f4b-4cf5-422a-af91-9b09c5ceeca8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:35.767215 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ce157f4b-4cf5-422a-af91-9b09c5ceeca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:35.825263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157f4b-4cf5-422a-af91-9b09c5ceeca8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:35.829296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add6208-4885-4fba-83ac-508bf05bb744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:35.829965 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add6208-4885-4fba-83ac-508bf05bb744 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:35.830250 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add6208-4885-4fba-83ac-508bf05bb744 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:35.830525 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add6208-4885-4fba-83ac-508bf05bb744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:35.839640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add6208-4885-4fba-83ac-508bf05bb744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:35.841043 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add6208-4885-4fba-83ac-508bf05bb744 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:35.850205 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1065/2114] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:35 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:35.995484 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52d895-6ef0-4d57-82a2-ffcc41959330 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:36.005364 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52d895-6ef0-4d57-82a2-ffcc41959330 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:36.009714 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ee96a-d9c2-4a29-9ee0-09940c01b08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:36.010337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ee96a-d9c2-4a29-9ee0-09940c01b08e service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:36.010613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ee96a-d9c2-4a29-9ee0-09940c01b08e service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:36.010914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ee96a-d9c2-4a29-9ee0-09940c01b08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:36.063308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ee96a-d9c2-4a29-9ee0-09940c01b08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:36.064991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ee96a-d9c2-4a29-9ee0-09940c01b08e service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:36.074769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1050/2115] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:35 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:47.447689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069adf1-ad79-4136-b71a-f43683aeeb82 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:47.449140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069adf1-ad79-4136-b71a-f43683aeeb82 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:47.450407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069adf1-ad79-4136-b71a-f43683aeeb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:47.470633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4069adf1-ad79-4136-b71a-f43683aeeb82 None None] MFA Rules not processed for user `54f058a8f1014fde9d4ec742e8174d00`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:47.472073 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4069adf1-ad79-4136-b71a-f43683aeeb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:47.550359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1066/2116] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:48.511221 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ee96a-d9c2-4a29-9ee0-09940c01b08e service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:48.587240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ee96a-d9c2-4a29-9ee0-09940c01b08e service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:48.593058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:48.594307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:48.594781 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:48.595248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] PATH_INFO: `/v3/users/c0bb840c481641c78b8c64fb4ab4c680` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:48.596990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0bb840c481641c78b8c64fb4ab4c680)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:48.599265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:48.663366 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0bb840c481641c78b8c64fb4ab4c680'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:48.672791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0bb840c481641c78b8c64fb4ab4c680'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:48.688605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0bb840c481641c78b8c64fb4ab4c680'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:48.708059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0bb840c481641c78b8c64fb4ab4c680'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:48.708795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0bb840c481641c78b8c64fb4ab4c680'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:48.716332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1051/2117] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:48 2022] DELETE /identity/v3/users/c0bb840c481641c78b8c64fb4ab4c680 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:48.720682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994e68-4fc0-425d-908f-775eba9f5d18 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:48.721165 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994e68-4fc0-425d-908f-775eba9f5d18 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:48.721247 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994e68-4fc0-425d-908f-775eba9f5d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:48.741922 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:48.744349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:48.746516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-df994e68-4fc0-425d-908f-775eba9f5d18 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:48.747903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-df994e68-4fc0-425d-908f-775eba9f5d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:48.818613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1067/2118] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:48.829466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bc118-b026-465d-a5c3-e27ca1312eec admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:48.834338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856c431-5a9b-44a1-83ca-8e6c50a07b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:48.835360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df994e68-4fc0-425d-908f-775eba9f5d18 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:48.835527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c431-5a9b-44a1-83ca-8e6c50a07b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:48.835631 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c431-5a9b-44a1-83ca-8e6c50a07b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:48.835998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c431-5a9b-44a1-83ca-8e6c50a07b65 admin admin] PATH_INFO: `/v3/users/b040fdf94e0d43ad9b832fdf046ab6d8` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:48.837413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856c431-5a9b-44a1-83ca-8e6c50a07b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b040fdf94e0d43ad9b832fdf046ab6d8)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:48.839372 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856c431-5a9b-44a1-83ca-8e6c50a07b65 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:48.844003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-df994e68-4fc0-425d-908f-775eba9f5d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:48.898512 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b856c431-5a9b-44a1-83ca-8e6c50a07b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b040fdf94e0d43ad9b832fdf046ab6d8'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:48.911039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b856c431-5a9b-44a1-83ca-8e6c50a07b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b040fdf94e0d43ad9b832fdf046ab6d8'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:48.914341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df994e68-4fc0-425d-908f-775eba9f5d18 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:48.918515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d110f9-7075-4703-8511-7c96ea78a609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:48.919256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d110f9-7075-4703-8511-7c96ea78a609 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:48.919628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d110f9-7075-4703-8511-7c96ea78a609 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:48.919904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d110f9-7075-4703-8511-7c96ea78a609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:48.920248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b856c431-5a9b-44a1-83ca-8e6c50a07b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b040fdf94e0d43ad9b832fdf046ab6d8'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:48.929849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d110f9-7075-4703-8511-7c96ea78a609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:48.931581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d110f9-7075-4703-8511-7c96ea78a609 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:48.933211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b856c431-5a9b-44a1-83ca-8e6c50a07b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b040fdf94e0d43ad9b832fdf046ab6d8'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:48.933957 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b856c431-5a9b-44a1-83ca-8e6c50a07b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b040fdf94e0d43ad9b832fdf046ab6d8'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:48.940186 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1052/2119] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:48 2022] DELETE /identity/v3/users/b040fdf94e0d43ad9b832fdf046ab6d8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:48.944209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1068/2120] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:48.947393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b1fd-689a-4bbb-85c7-cee58bcba415 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:48.947828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b1fd-689a-4bbb-85c7-cee58bcba415 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:48.948108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b1fd-689a-4bbb-85c7-cee58bcba415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:48.966794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d2b0b1fd-689a-4bbb-85c7-cee58bcba415 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:48.968009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d2b0b1fd-689a-4bbb-85c7-cee58bcba415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:49.030158 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1053/2121] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:49.040707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d110f9-7075-4703-8511-7c96ea78a609 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:49.049926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d110f9-7075-4703-8511-7c96ea78a609 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:49.107137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a8d8-316b-46ce-99aa-901209003f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:49.107777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a8d8-316b-46ce-99aa-901209003f41 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:49.108231 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a8d8-316b-46ce-99aa-901209003f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:49.108516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a8d8-316b-46ce-99aa-901209003f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:49.119289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6a8d8-316b-46ce-99aa-901209003f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:49.121177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6a8d8-316b-46ce-99aa-901209003f41 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:49.130780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1069/2122] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:51:49.271886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0b1fd-689a-4bbb-85c7-cee58bcba415 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:49.274217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d2b0b1fd-689a-4bbb-85c7-cee58bcba415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:49.287791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0b1fd-689a-4bbb-85c7-cee58bcba415 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:49.293638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:49.294506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:49.294821 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:49.295108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] PATH_INFO: `/v3/projects/fd5ee388a3b1403eafd6d30965c5bfbb` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:49.296365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5ee388a3b1403eafd6d30965c5bfbb)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:49.298277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:49.358674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5ee388a3b1403eafd6d30965c5bfbb', 'request_id': 'req-28fe78c5-0976-4212-9a33-bc2f46353107'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.367775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5ee388a3b1403eafd6d30965c5bfbb', 'request_id': 'req-28fe78c5-0976-4212-9a33-bc2f46353107'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.374905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5ee388a3b1403eafd6d30965c5bfbb', 'request_id': 'req-28fe78c5-0976-4212-9a33-bc2f46353107'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.388983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] The token cache is being invalidate because project fd5ee388a3b1403eafd6d30965c5bfbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:49.389304 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.390170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.392684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1054/2123] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:49 2022] DELETE /identity/v3/projects/fd5ee388a3b1403eafd6d30965c5bfbb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:49.396766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a8d8-316b-46ce-99aa-901209003f41 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:49.407706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a8d8-316b-46ce-99aa-901209003f41 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:49.472103 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421b0db-bb5f-4b2e-9dcb-d94b91d3a920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:49.473005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421b0db-bb5f-4b2e-9dcb-d94b91d3a920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:49.473288 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421b0db-bb5f-4b2e-9dcb-d94b91d3a920 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:49.473565 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421b0db-bb5f-4b2e-9dcb-d94b91d3a920 admin admin] PATH_INFO: `/v3/users/310f3ab3b54b49eab58123ef55332c01` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:49.474804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421b0db-bb5f-4b2e-9dcb-d94b91d3a920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=310f3ab3b54b49eab58123ef55332c01)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:49.476756 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421b0db-bb5f-4b2e-9dcb-d94b91d3a920 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:49.498093 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:49.499641 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:49.540559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-5421b0db-bb5f-4b2e-9dcb-d94b91d3a920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310f3ab3b54b49eab58123ef55332c01'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.545948 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe78c5-0976-4212-9a33-bc2f46353107 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:49.553518 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-5421b0db-bb5f-4b2e-9dcb-d94b91d3a920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310f3ab3b54b49eab58123ef55332c01'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.554789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-5421b0db-bb5f-4b2e-9dcb-d94b91d3a920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310f3ab3b54b49eab58123ef55332c01'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.555390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-5421b0db-bb5f-4b2e-9dcb-d94b91d3a920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310f3ab3b54b49eab58123ef55332c01'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.556273 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:49.557163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:49.558320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:49.558617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] PATH_INFO: `/v3/projects/e711c82de9fb4acf9a9079c0abfb62de` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:49.560428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e711c82de9fb4acf9a9079c0abfb62de)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:49.562511 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:49.567121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-5421b0db-bb5f-4b2e-9dcb-d94b91d3a920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310f3ab3b54b49eab58123ef55332c01'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.584270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1070/2124] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:51:49 2022] DELETE /identity/v3/users/310f3ab3b54b49eab58123ef55332c01 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:49.642622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e711c82de9fb4acf9a9079c0abfb62de', 'request_id': 'req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.652009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e711c82de9fb4acf9a9079c0abfb62de', 'request_id': 'req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.663907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e711c82de9fb4acf9a9079c0abfb62de', 'request_id': 'req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.680845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] The token cache is being invalidate because project e711c82de9fb4acf9a9079c0abfb62de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:49.681230 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.682019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a593ce56-dfe0-4d74-8e5f-1e152887f9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:49.684465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1055/2125] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:49 2022] DELETE /identity/v3/projects/e711c82de9fb4acf9a9079c0abfb62de => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:49.694397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637c01e-1036-4a64-8e94-227767894b4e None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:49.695433 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637c01e-1036-4a64-8e94-227767894b4e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:49.695845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637c01e-1036-4a64-8e94-227767894b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:49.730083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f637c01e-1036-4a64-8e94-227767894b4e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:49.731680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f637c01e-1036-4a64-8e94-227767894b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:49.825676 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1071/2126] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:49.828216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f070-3ad4-418c-b9aa-c17f592c0211 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:49.828803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f070-3ad4-418c-b9aa-c17f592c0211 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:49.829235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f070-3ad4-418c-b9aa-c17f592c0211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:49.857348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-32d3f070-3ad4-418c-b9aa-c17f592c0211 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:49.859529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-32d3f070-3ad4-418c-b9aa-c17f592c0211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:49.873423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1056/2127] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:49.877767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637c01e-1036-4a64-8e94-227767894b4e None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:49.892826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637c01e-1036-4a64-8e94-227767894b4e None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:49.908593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5edd5-632c-4e67-adf0-5bef436c50fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:49.910876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5edd5-632c-4e67-adf0-5bef436c50fd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:49.912730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5edd5-632c-4e67-adf0-5bef436c50fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:49.913449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5edd5-632c-4e67-adf0-5bef436c50fd admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:49.914604 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5edd5-632c-4e67-adf0-5bef436c50fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:49.915305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5edd5-632c-4e67-adf0-5bef436c50fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:49.919467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5edd5-632c-4e67-adf0-5bef436c50fd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:49.949863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1072/2128] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:51:49.954125 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3f070-3ad4-418c-b9aa-c17f592c0211 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:49.968032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3f070-3ad4-418c-b9aa-c17f592c0211 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:49.973703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dc5d7-74d2-4aa4-8288-020d080c7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:49.974466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dc5d7-74d2-4aa4-8288-020d080c7f1f admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:49.974840 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dc5d7-74d2-4aa4-8288-020d080c7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:49.975124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dc5d7-74d2-4aa4-8288-020d080c7f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:49.975873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dc5d7-74d2-4aa4-8288-020d080c7f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:49.978273 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dc5d7-74d2-4aa4-8288-020d080c7f1f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.011962 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1057/2129] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:49 2022] POST /identity/v3/projects => generated 392 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:50.017564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5edd5-632c-4e67-adf0-5bef436c50fd admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.019791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5de5edd5-632c-4e67-adf0-5bef436c50fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:50.027905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dc5d7-74d2-4aa4-8288-020d080c7f1f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.044710 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5edd5-632c-4e67-adf0-5bef436c50fd admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.110598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dc5d7-74d2-4aa4-8288-020d080c7f1f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.117045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a9e00-ce1a-40d2-973f-96b515b85245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.118108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a9e00-ce1a-40d2-973f-96b515b85245 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.118397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a9e00-ce1a-40d2-973f-96b515b85245 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.118815 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a9e00-ce1a-40d2-973f-96b515b85245 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.119865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a9e00-ce1a-40d2-973f-96b515b85245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.122603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a9e00-ce1a-40d2-973f-96b515b85245 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.125500 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.126475 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.126873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.127211 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] PATH_INFO: `/v3/projects/26129d8b2de74beb88363328b7725413` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.128497 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26129d8b2de74beb88363328b7725413)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.130621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.148541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1058/2130] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:50 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:50.153027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a9e00-ce1a-40d2-973f-96b515b85245 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.167050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a9e00-ce1a-40d2-973f-96b515b85245 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.178437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7819ad-c721-4266-869e-0807ef5b6eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.179349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7819ad-c721-4266-869e-0807ef5b6eff admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.179733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7819ad-c721-4266-869e-0807ef5b6eff admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.180245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7819ad-c721-4266-869e-0807ef5b6eff admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.181203 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7819ad-c721-4266-869e-0807ef5b6eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.182895 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7819ad-c721-4266-869e-0807ef5b6eff admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.199108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1059/2131] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:50 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:51:50.200465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7819ad-c721-4266-869e-0807ef5b6eff admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.213250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7819ad-c721-4266-869e-0807ef5b6eff admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.215774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26129d8b2de74beb88363328b7725413', 'request_id': 'req-c4bc18fd-f60b-47fe-960e-252704cf22b3'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:50.224903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26129d8b2de74beb88363328b7725413', 'request_id': 'req-c4bc18fd-f60b-47fe-960e-252704cf22b3'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:50.235776 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26129d8b2de74beb88363328b7725413', 'request_id': 'req-c4bc18fd-f60b-47fe-960e-252704cf22b3'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:50.248392 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] The token cache is being invalidate because project 26129d8b2de74beb88363328b7725413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:51:50.248817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:50.249603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4bc18fd-f60b-47fe-960e-252704cf22b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:51:50.251778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1073/2132] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:51:50 2022] DELETE /identity/v3/projects/26129d8b2de74beb88363328b7725413 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:50.258345 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927886ff-4440-40c9-96c6-facd225df3f8 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.258822 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927886ff-4440-40c9-96c6-facd225df3f8 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.259241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927886ff-4440-40c9-96c6-facd225df3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.276790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c569549-f12e-4a01-aea1-1b445f98f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.277474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569549-f12e-4a01-aea1-1b445f98f250 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.277759 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569549-f12e-4a01-aea1-1b445f98f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.278037 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569549-f12e-4a01-aea1-1b445f98f250 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.278835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c569549-f12e-4a01-aea1-1b445f98f250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.279457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-927886ff-4440-40c9-96c6-facd225df3f8 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:50.280497 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c569549-f12e-4a01-aea1-1b445f98f250 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.280925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-927886ff-4440-40c9-96c6-facd225df3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:50.291586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1074/2133] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:50.296112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1060/2134] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:50 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:50.297555 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927886ff-4440-40c9-96c6-facd225df3f8 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.299040 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-927886ff-4440-40c9-96c6-facd225df3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:50.299510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83059b97-f799-4ed2-b5af-366e27ea9559 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.299805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83059b97-f799-4ed2-b5af-366e27ea9559 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.300082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83059b97-f799-4ed2-b5af-366e27ea9559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.311556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927886ff-4440-40c9-96c6-facd225df3f8 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.316718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8525df-33fb-49d3-8e40-114b67d0cc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.317602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8525df-33fb-49d3-8e40-114b67d0cc21 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.317884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8525df-33fb-49d3-8e40-114b67d0cc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.318172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8525df-33fb-49d3-8e40-114b67d0cc21 admin admin] PATH_INFO: `/v3/projects/c50d182a98ba4d81aa9254a76c9a9fa4/users/ed36e6a9ae0b48e99c904298c76fd19c/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.322667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-83059b97-f799-4ed2-b5af-366e27ea9559 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:50.324147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-83059b97-f799-4ed2-b5af-366e27ea9559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:50.333355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1061/2135] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:50.336011 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8525df-33fb-49d3-8e40-114b67d0cc21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50d182a98ba4d81aa9254a76c9a9fa4, user_id=ed36e6a9ae0b48e99c904298c76fd19c, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.339473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83059b97-f799-4ed2-b5af-366e27ea9559 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.339626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8525df-33fb-49d3-8e40-114b67d0cc21 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.349235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83059b97-f799-4ed2-b5af-366e27ea9559 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.363039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1075/2136] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:50 2022] PUT /identity/v3/projects/c50d182a98ba4d81aa9254a76c9a9fa4/users/ed36e6a9ae0b48e99c904298c76fd19c/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:51:50.373967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b74e-d2a1-4c8b-911c-4c3de0c05b30 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.374273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b74e-d2a1-4c8b-911c-4c3de0c05b30 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.374519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b74e-d2a1-4c8b-911c-4c3de0c05b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.405523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5d07b74e-d2a1-4c8b-911c-4c3de0c05b30 None None] MFA Rules not processed for user `ed36e6a9ae0b48e99c904298c76fd19c`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:50.406789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5d07b74e-d2a1-4c8b-911c-4c3de0c05b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:50.418721 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3360a2-6bfa-4237-a2ae-5e9d88a3d5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.419762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3360a2-6bfa-4237-a2ae-5e9d88a3d5de admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.420259 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3360a2-6bfa-4237-a2ae-5e9d88a3d5de admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.420732 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3360a2-6bfa-4237-a2ae-5e9d88a3d5de admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.421802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3360a2-6bfa-4237-a2ae-5e9d88a3d5de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:51:50.422402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3360a2-6bfa-4237-a2ae-5e9d88a3d5de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.424179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3360a2-6bfa-4237-a2ae-5e9d88a3d5de admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.440724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1062/2137] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:51:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:51:50.445864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3360a2-6bfa-4237-a2ae-5e9d88a3d5de admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.469050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3360a2-6bfa-4237-a2ae-5e9d88a3d5de admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.476585 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef7e8d-f28d-4665-ae4b-209b0fec614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.477260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef7e8d-f28d-4665-ae4b-209b0fec614a admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.478224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef7e8d-f28d-4665-ae4b-209b0fec614a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.478507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef7e8d-f28d-4665-ae4b-209b0fec614a admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.479267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef7e8d-f28d-4665-ae4b-209b0fec614a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.481339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef7e8d-f28d-4665-ae4b-209b0fec614a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.501976 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1076/2138] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:51:50.514346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1063/2139] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:51:50 2022] POST /identity/v3/projects => generated 386 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:51:50.516873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b74e-d2a1-4c8b-911c-4c3de0c05b30 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.518345 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef7e8d-f28d-4665-ae4b-209b0fec614a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.521017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-65ef7e8d-f28d-4665-ae4b-209b0fec614a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:50.534621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b74e-d2a1-4c8b-911c-4c3de0c05b30 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.585720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef7e8d-f28d-4665-ae4b-209b0fec614a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.589460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a84f90-7e81-4b36-a506-369244c500e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.590113 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a84f90-7e81-4b36-a506-369244c500e4 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.590396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a84f90-7e81-4b36-a506-369244c500e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.590672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a84f90-7e81-4b36-a506-369244c500e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.619373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c1311-f108-443c-9f2e-10db26031e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.620045 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c1311-f108-443c-9f2e-10db26031e84 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.620328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c1311-f108-443c-9f2e-10db26031e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.620861 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c1311-f108-443c-9f2e-10db26031e84 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.621364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c1311-f108-443c-9f2e-10db26031e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.623360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c1311-f108-443c-9f2e-10db26031e84 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.646488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1077/2140] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:51:50 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:51:50.648154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31702bb-1130-4326-b7b1-1abcaa5e5e6d None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.648509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31702bb-1130-4326-b7b1-1abcaa5e5e6d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.648809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31702bb-1130-4326-b7b1-1abcaa5e5e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.670912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d31702bb-1130-4326-b7b1-1abcaa5e5e6d None None] MFA Rules not processed for user `feb8ddf0abd84c1caed8501c57b56f20`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:50.672333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d31702bb-1130-4326-b7b1-1abcaa5e5e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:50.686551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a84f90-7e81-4b36-a506-369244c500e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.689140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a84f90-7e81-4b36-a506-369244c500e4 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.701725 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1064/2141] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:51:50.702800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a84f90-7e81-4b36-a506-369244c500e4 service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.717184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a84f90-7e81-4b36-a506-369244c500e4 service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.728755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b521650-ff4d-4328-b511-4fd24b1308fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.729735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b521650-ff4d-4328-b511-4fd24b1308fb admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.731149 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b521650-ff4d-4328-b511-4fd24b1308fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.731736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b521650-ff4d-4328-b511-4fd24b1308fb admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.732665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b521650-ff4d-4328-b511-4fd24b1308fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.736965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b521650-ff4d-4328-b511-4fd24b1308fb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.748310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1078/2142] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:50.761556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1065/2143] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:50 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:50.765803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31702bb-1130-4326-b7b1-1abcaa5e5e6d None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.778383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31702bb-1130-4326-b7b1-1abcaa5e5e6d None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.783071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07f52f-391b-4d55-b514-d98c0c9a0a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.783725 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07f52f-391b-4d55-b514-d98c0c9a0a4e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.784166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07f52f-391b-4d55-b514-d98c0c9a0a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.784444 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07f52f-391b-4d55-b514-d98c0c9a0a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.785176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07f52f-391b-4d55-b514-d98c0c9a0a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.786765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07f52f-391b-4d55-b514-d98c0c9a0a4e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.797854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1079/2144] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:51:50 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:51:50.801890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b521650-ff4d-4328-b511-4fd24b1308fb admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:50.814381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b521650-ff4d-4328-b511-4fd24b1308fb admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:50.820257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9bcce-1cef-49c1-8914-d28c9551d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:50.821296 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9bcce-1cef-49c1-8914-d28c9551d3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.821653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9bcce-1cef-49c1-8914-d28c9551d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.822002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9bcce-1cef-49c1-8914-d28c9551d3bd admin admin] PATH_INFO: `/v3/projects/316f0b5d8c4b4f74a45255608e2ba99c/users/e12e185b594f4f38a6f8505be7b4ac44/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.839788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9bcce-1cef-49c1-8914-d28c9551d3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=316f0b5d8c4b4f74a45255608e2ba99c, user_id=e12e185b594f4f38a6f8505be7b4ac44, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:50.843108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9bcce-1cef-49c1-8914-d28c9551d3bd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:50.860179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1066/2145] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:51:50 2022] PUT /identity/v3/projects/316f0b5d8c4b4f74a45255608e2ba99c/users/e12e185b594f4f38a6f8505be7b4ac44/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:51:50.872984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612787a-f4a8-4d65-865c-7c4a826e85bd None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:50.873380 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612787a-f4a8-4d65-865c-7c4a826e85bd None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:50.873823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612787a-f4a8-4d65-865c-7c4a826e85bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:50.906919 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-3612787a-f4a8-4d65-865c-7c4a826e85bd None None] MFA Rules not processed for user `e12e185b594f4f38a6f8505be7b4ac44`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:51:50.908019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3612787a-f4a8-4d65-865c-7c4a826e85bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:51:50.988163 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1080/2146] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:51:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:51:51.012812 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9bcce-1cef-49c1-8914-d28c9551d3bd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:51:51.104212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9bcce-1cef-49c1-8914-d28c9551d3bd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:51:51.108826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee518a-6772-4043-845d-5e9865992eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:51:51.109552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee518a-6772-4043-845d-5e9865992eaa service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:51:51.109865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee518a-6772-4043-845d-5e9865992eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:51:51.110296 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee518a-6772-4043-845d-5e9865992eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:51:51.121850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee518a-6772-4043-845d-5e9865992eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:51:51.123430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee518a-6772-4043-845d-5e9865992eaa service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:51:51.142309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1067/2147] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:51:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:52:08.921488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612787a-f4a8-4d65-865c-7c4a826e85bd None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:08.984106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612787a-f4a8-4d65-865c-7c4a826e85bd None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:08.988819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:08.989686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:08.990505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:08.990864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] PATH_INFO: `/v3/users/e12e185b594f4f38a6f8505be7b4ac44` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:08.992108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12e185b594f4f38a6f8505be7b4ac44)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:08.994090 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:09.039458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12e185b594f4f38a6f8505be7b4ac44'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:09.051726 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12e185b594f4f38a6f8505be7b4ac44'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:09.053088 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12e185b594f4f38a6f8505be7b4ac44'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:09.053708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12e185b594f4f38a6f8505be7b4ac44'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:09.060465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12e185b594f4f38a6f8505be7b4ac44'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:09.073583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1081/2148] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:52:08 2022] DELETE /identity/v3/users/e12e185b594f4f38a6f8505be7b4ac44 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:09.078109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee68e1-3c87-4cd6-ba0a-e4ec935f3c56 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:09.078633 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee68e1-3c87-4cd6-ba0a-e4ec935f3c56 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:09.078733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee68e1-3c87-4cd6-ba0a-e4ec935f3c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:09.096410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d6ee68e1-3c87-4cd6-ba0a-e4ec935f3c56 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:09.097614 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d6ee68e1-3c87-4cd6-ba0a-e4ec935f3c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:09.155752 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1068/2149] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:09.166714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:09.168121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:09.226338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4b5e6-befc-4cf0-a1ec-c24b9f8444a6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:09.230987 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92b6e5-c8bf-4774-a9ca-c9d9e6934ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:09.231739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92b6e5-c8bf-4774-a9ca-c9d9e6934ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:09.232036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92b6e5-c8bf-4774-a9ca-c9d9e6934ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:09.232316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92b6e5-c8bf-4774-a9ca-c9d9e6934ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:09.242726 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92b6e5-c8bf-4774-a9ca-c9d9e6934ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:09.244168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92b6e5-c8bf-4774-a9ca-c9d9e6934ab5 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:09.253315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1082/2150] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:52:09.524292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee68e1-3c87-4cd6-ba0a-e4ec935f3c56 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:09.525896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d6ee68e1-3c87-4cd6-ba0a-e4ec935f3c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:09.554786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee68e1-3c87-4cd6-ba0a-e4ec935f3c56 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:09.568214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:09.569134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:09.569360 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:09.574017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] PATH_INFO: `/v3/projects/316f0b5d8c4b4f74a45255608e2ba99c` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:09.575376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=316f0b5d8c4b4f74a45255608e2ba99c)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:09.581990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:09.636910 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316f0b5d8c4b4f74a45255608e2ba99c', 'request_id': 'req-bf70b409-386f-4ab3-bee3-abd58f74f954'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:09.644256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316f0b5d8c4b4f74a45255608e2ba99c', 'request_id': 'req-bf70b409-386f-4ab3-bee3-abd58f74f954'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:09.650916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316f0b5d8c4b4f74a45255608e2ba99c', 'request_id': 'req-bf70b409-386f-4ab3-bee3-abd58f74f954'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:09.660801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] The token cache is being invalidate because project 316f0b5d8c4b4f74a45255608e2ba99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:52:09.661089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:09.661767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bf70b409-386f-4ab3-bee3-abd58f74f954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:09.663911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1069/2151] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:52:09 2022] DELETE /identity/v3/projects/316f0b5d8c4b4f74a45255608e2ba99c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:09.670058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535138-3949-4db3-bb50-edb759e01d67 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:09.670342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535138-3949-4db3-bb50-edb759e01d67 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:09.670616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535138-3949-4db3-bb50-edb759e01d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:09.688157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-6a535138-3949-4db3-bb50-edb759e01d67 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:09.689549 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6a535138-3949-4db3-bb50-edb759e01d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:09.748201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1083/2152] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:52:09.756020 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29ce44-6fb6-422c-ba72-6b7760a2f980 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:09.756338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29ce44-6fb6-422c-ba72-6b7760a2f980 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:09.756621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29ce44-6fb6-422c-ba72-6b7760a2f980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:09.775901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-1f29ce44-6fb6-422c-ba72-6b7760a2f980 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:09.777113 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1f29ce44-6fb6-422c-ba72-6b7760a2f980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:09.784899 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1070/2153] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:09.791248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a535138-3949-4db3-bb50-edb759e01d67 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:09.801697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a535138-3949-4db3-bb50-edb759e01d67 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:09.807575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7411bae-3180-4d02-9b66-b5975b842914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:09.808232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411bae-3180-4d02-9b66-b5975b842914 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:09.808513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411bae-3180-4d02-9b66-b5975b842914 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:09.808784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411bae-3180-4d02-9b66-b5975b842914 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:09.809517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7411bae-3180-4d02-9b66-b5975b842914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:52:09.809817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7411bae-3180-4d02-9b66-b5975b842914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:09.811424 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7411bae-3180-4d02-9b66-b5975b842914 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:09.825321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1084/2154] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:52:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:52:09.837410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29ce44-6fb6-422c-ba72-6b7760a2f980 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:09.856584 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29ce44-6fb6-422c-ba72-6b7760a2f980 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:09.871042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309f792-db0b-4231-b50d-906a5157d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:09.871784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f792-db0b-4231-b50d-906a5157d392 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:09.872022 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f792-db0b-4231-b50d-906a5157d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:09.872310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f792-db0b-4231-b50d-906a5157d392 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:09.873044 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309f792-db0b-4231-b50d-906a5157d392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:09.876750 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309f792-db0b-4231-b50d-906a5157d392 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:09.916185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1071/2155] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:52:09 2022] POST /identity/v3/projects => generated 378 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:52:09.920613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7411bae-3180-4d02-9b66-b5975b842914 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:09.942616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7411bae-3180-4d02-9b66-b5975b842914 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:10.039373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2796dc-a80f-47fd-adda-0329a6d35215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:10.039373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2796dc-a80f-47fd-adda-0329a6d35215 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.039373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2796dc-a80f-47fd-adda-0329a6d35215 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.039373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2796dc-a80f-47fd-adda-0329a6d35215 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.039936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2796dc-a80f-47fd-adda-0329a6d35215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:10.040534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2796dc-a80f-47fd-adda-0329a6d35215 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:10.093218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1085/2156] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:52:09 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:52:10.098240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309f792-db0b-4231-b50d-906a5157d392 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:10.112903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309f792-db0b-4231-b50d-906a5157d392 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:10.122602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d1993-185a-4c7f-bc02-1679e7c2a9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:10.124009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d1993-185a-4c7f-bc02-1679e7c2a9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.124368 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d1993-185a-4c7f-bc02-1679e7c2a9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.124733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d1993-185a-4c7f-bc02-1679e7c2a9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.125600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d1993-185a-4c7f-bc02-1679e7c2a9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:10.127385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d1993-185a-4c7f-bc02-1679e7c2a9f8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:10.151762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1072/2157] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:52:10 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:52:10.158896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2796dc-a80f-47fd-adda-0329a6d35215 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:10.171544 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2796dc-a80f-47fd-adda-0329a6d35215 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:10.179374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127d031-9476-4c79-95cd-fdb5d43be8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:10.180310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127d031-9476-4c79-95cd-fdb5d43be8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.181156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127d031-9476-4c79-95cd-fdb5d43be8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.181595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127d031-9476-4c79-95cd-fdb5d43be8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.182513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127d031-9476-4c79-95cd-fdb5d43be8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:10.185202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127d031-9476-4c79-95cd-fdb5d43be8f1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:10.198398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1086/2158] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:52:10 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:52:10.202609 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d1993-185a-4c7f-bc02-1679e7c2a9f8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:10.231187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d1993-185a-4c7f-bc02-1679e7c2a9f8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:10.238620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9791b-aba2-45ea-8d43-2746f05c6c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:10.239620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9791b-aba2-45ea-8d43-2746f05c6c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.240638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9791b-aba2-45ea-8d43-2746f05c6c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.241264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9791b-aba2-45ea-8d43-2746f05c6c4c admin admin] PATH_INFO: `/v3/projects/9ac8c04d48da4518966fd498b1aa9297/users/3814a41f27cc464a87e15c3595e58a64/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.266288 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9791b-aba2-45ea-8d43-2746f05c6c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac8c04d48da4518966fd498b1aa9297, user_id=3814a41f27cc464a87e15c3595e58a64, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:10.278318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9791b-aba2-45ea-8d43-2746f05c6c4c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:10.320935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1073/2159] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:52:10 2022] PUT /identity/v3/projects/9ac8c04d48da4518966fd498b1aa9297/users/3814a41f27cc464a87e15c3595e58a64/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:52:10.332724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d06e7-efca-482a-ab1e-76d68f79db7b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.333250 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d06e7-efca-482a-ab1e-76d68f79db7b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.333839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d06e7-efca-482a-ab1e-76d68f79db7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.365211 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-329d06e7-efca-482a-ab1e-76d68f79db7b None None] MFA Rules not processed for user `3814a41f27cc464a87e15c3595e58a64`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:10.366897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-329d06e7-efca-482a-ab1e-76d68f79db7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:10.457048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1087/2160] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:10.462527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9791b-aba2-45ea-8d43-2746f05c6c4c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:10.530763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9791b-aba2-45ea-8d43-2746f05c6c4c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:10.535771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0bde2-f2e1-43f1-92c2-37105a20f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:10.536422 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0bde2-f2e1-43f1-92c2-37105a20f5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.537100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0bde2-f2e1-43f1-92c2-37105a20f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.537437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0bde2-f2e1-43f1-92c2-37105a20f5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.538151 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0bde2-f2e1-43f1-92c2-37105a20f5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:10.540107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0bde2-f2e1-43f1-92c2-37105a20f5c5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:10.566199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1074/2161] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:52:10 2022] POST /identity/v3/projects => generated 376 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:52:10.571314 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d06e7-efca-482a-ab1e-76d68f79db7b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:10.581694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d06e7-efca-482a-ab1e-76d68f79db7b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:10.644349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9209e3-48a5-4460-be14-3f66ace2cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:10.645089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9209e3-48a5-4460-be14-3f66ace2cbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.645370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9209e3-48a5-4460-be14-3f66ace2cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.645643 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9209e3-48a5-4460-be14-3f66ace2cbe7 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.646547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9209e3-48a5-4460-be14-3f66ace2cbe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:10.649411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9209e3-48a5-4460-be14-3f66ace2cbe7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:10.674181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1088/2162] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:52:10 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:52:10.679088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0bde2-f2e1-43f1-92c2-37105a20f5c5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:10.689429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0bde2-f2e1-43f1-92c2-37105a20f5c5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:10.694520 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144b5e-3071-40aa-87ae-e57eb9707a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:10.695200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144b5e-3071-40aa-87ae-e57eb9707a30 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.695476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144b5e-3071-40aa-87ae-e57eb9707a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.695745 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144b5e-3071-40aa-87ae-e57eb9707a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.696538 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb144b5e-3071-40aa-87ae-e57eb9707a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:10.698114 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb144b5e-3071-40aa-87ae-e57eb9707a30 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:10.707789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1075/2163] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:52:10 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:52:10.712094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9209e3-48a5-4460-be14-3f66ace2cbe7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:10.722401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9209e3-48a5-4460-be14-3f66ace2cbe7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:10.727753 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5599-a614-46b6-8e7d-7bea6f81267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:10.728392 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5599-a614-46b6-8e7d-7bea6f81267d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.728669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5599-a614-46b6-8e7d-7bea6f81267d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.728943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5599-a614-46b6-8e7d-7bea6f81267d admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.729672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a5599-a614-46b6-8e7d-7bea6f81267d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:10.731281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a5599-a614-46b6-8e7d-7bea6f81267d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:10.741543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1089/2164] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:52:10 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:52:10.745738 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144b5e-3071-40aa-87ae-e57eb9707a30 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:10.758724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144b5e-3071-40aa-87ae-e57eb9707a30 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:10.763733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5a988-5765-4be1-90ea-c9b4d668247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:10.764617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5a988-5765-4be1-90ea-c9b4d668247e admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.764896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5a988-5765-4be1-90ea-c9b4d668247e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.765196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5a988-5765-4be1-90ea-c9b4d668247e admin admin] PATH_INFO: `/v3/projects/6f6526ce25cc4146ab6973e250a66d7a/users/aa2822ec81fc430ebdb491eddcfb36bf/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.783665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5a988-5765-4be1-90ea-c9b4d668247e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6526ce25cc4146ab6973e250a66d7a, user_id=aa2822ec81fc430ebdb491eddcfb36bf, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:10.786377 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5a988-5765-4be1-90ea-c9b4d668247e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:10.799214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1076/2165] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:52:10 2022] PUT /identity/v3/projects/6f6526ce25cc4146ab6973e250a66d7a/users/aa2822ec81fc430ebdb491eddcfb36bf/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:10.810984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622bb6f-674d-4858-aea8-8bdf646fa667 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.811271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622bb6f-674d-4858-aea8-8bdf646fa667 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.811545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622bb6f-674d-4858-aea8-8bdf646fa667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.840166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4622bb6f-674d-4858-aea8-8bdf646fa667 None None] MFA Rules not processed for user `aa2822ec81fc430ebdb491eddcfb36bf`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:10.841367 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4622bb6f-674d-4858-aea8-8bdf646fa667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:10.907545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1090/2166] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:10.912794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5a988-5765-4be1-90ea-c9b4d668247e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:10.976203 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5a988-5765-4be1-90ea-c9b4d668247e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:10.981204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53e373-20e9-4374-94b0-763986579cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:10.981864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e373-20e9-4374-94b0-763986579cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:10.982144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e373-20e9-4374-94b0-763986579cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:10.982422 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e373-20e9-4374-94b0-763986579cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:10.983496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53e373-20e9-4374-94b0-763986579cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:10.985071 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53e373-20e9-4374-94b0-763986579cc1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:11.014833 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1077/2167] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:52:10 2022] POST /identity/v3/projects => generated 376 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:52:11.015960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622bb6f-674d-4858-aea8-8bdf646fa667 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:11.027622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622bb6f-674d-4858-aea8-8bdf646fa667 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:11.089337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440bd6c-27df-4036-bc9e-d646d7b10538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:11.090314 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bd6c-27df-4036-bc9e-d646d7b10538 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:11.090314 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bd6c-27df-4036-bc9e-d646d7b10538 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:11.090608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bd6c-27df-4036-bc9e-d646d7b10538 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:11.091536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440bd6c-27df-4036-bc9e-d646d7b10538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:11.093435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440bd6c-27df-4036-bc9e-d646d7b10538 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:11.116631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1091/2168] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:52:11 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:52:11.120990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53e373-20e9-4374-94b0-763986579cc1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:11.132670 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53e373-20e9-4374-94b0-763986579cc1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:11.138118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f8bef-09f1-4e03-9516-9459bad8de8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:11.138963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8bef-09f1-4e03-9516-9459bad8de8c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:11.139251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8bef-09f1-4e03-9516-9459bad8de8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:11.139527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8bef-09f1-4e03-9516-9459bad8de8c admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:11.140450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f8bef-09f1-4e03-9516-9459bad8de8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:11.142112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f8bef-09f1-4e03-9516-9459bad8de8c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:11.179770 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1078/2169] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:52:11 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:52:11.183937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440bd6c-27df-4036-bc9e-d646d7b10538 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:11.197587 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440bd6c-27df-4036-bc9e-d646d7b10538 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:11.202545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873c45-e03c-4323-9368-7c8f41c1d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:11.203551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873c45-e03c-4323-9368-7c8f41c1d2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:11.203902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873c45-e03c-4323-9368-7c8f41c1d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:11.204353 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873c45-e03c-4323-9368-7c8f41c1d2e6 admin admin] PATH_INFO: `/v3/projects/37e206d574884ea797cbe418b6d03995/users/c480bb8ff5f84af6b175adc012cbab16/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:11.220289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873c45-e03c-4323-9368-7c8f41c1d2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e206d574884ea797cbe418b6d03995, user_id=c480bb8ff5f84af6b175adc012cbab16, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:11.223088 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873c45-e03c-4323-9368-7c8f41c1d2e6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:11.256306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1092/2170] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:52:11 2022] PUT /identity/v3/projects/37e206d574884ea797cbe418b6d03995/users/c480bb8ff5f84af6b175adc012cbab16/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:11.260372 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f8bef-09f1-4e03-9516-9459bad8de8c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:11.270726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f8bef-09f1-4e03-9516-9459bad8de8c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:11.335059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932c47f-115f-4b21-aaa4-fcb880ce340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:11.335741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932c47f-115f-4b21-aaa4-fcb880ce340c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:11.336032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932c47f-115f-4b21-aaa4-fcb880ce340c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:11.336313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932c47f-115f-4b21-aaa4-fcb880ce340c admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:11.337067 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932c47f-115f-4b21-aaa4-fcb880ce340c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:11.338805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932c47f-115f-4b21-aaa4-fcb880ce340c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:11.355808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1079/2171] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:52:11 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:52:11.356945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873c45-e03c-4323-9368-7c8f41c1d2e6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:11.367144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873c45-e03c-4323-9368-7c8f41c1d2e6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:11.371874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe46e-7e8b-4dfd-8972-1097f3e19982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:11.372748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe46e-7e8b-4dfd-8972-1097f3e19982 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:11.373033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe46e-7e8b-4dfd-8972-1097f3e19982 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:11.373311 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe46e-7e8b-4dfd-8972-1097f3e19982 admin admin] PATH_INFO: `/v3/projects/37e206d574884ea797cbe418b6d03995/users/c480bb8ff5f84af6b175adc012cbab16/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:11.375359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fe46e-7e8b-4dfd-8972-1097f3e19982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e206d574884ea797cbe418b6d03995, user_id=c480bb8ff5f84af6b175adc012cbab16, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:11.378099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fe46e-7e8b-4dfd-8972-1097f3e19982 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:11.389696 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1093/2172] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:52:11 2022] PUT /identity/v3/projects/37e206d574884ea797cbe418b6d03995/users/c480bb8ff5f84af6b175adc012cbab16/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:11.400819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d0867-8f34-4c0d-bb7a-a7f6540b1568 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:11.401140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d0867-8f34-4c0d-bb7a-a7f6540b1568 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:11.401420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d0867-8f34-4c0d-bb7a-a7f6540b1568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:11.428494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-5b0d0867-8f34-4c0d-bb7a-a7f6540b1568 None None] MFA Rules not processed for user `c480bb8ff5f84af6b175adc012cbab16`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:11.429746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5b0d0867-8f34-4c0d-bb7a-a7f6540b1568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:11.500522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1080/2173] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:52:11.511666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe46e-7e8b-4dfd-8972-1097f3e19982 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:11.513766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d82fe46e-7e8b-4dfd-8972-1097f3e19982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:11.571988 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe46e-7e8b-4dfd-8972-1097f3e19982 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:11.575673 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf54ba-a992-4fe7-b866-e23043ef2e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:11.576367 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf54ba-a992-4fe7-b866-e23043ef2e9f service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:11.576652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf54ba-a992-4fe7-b866-e23043ef2e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:11.576970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf54ba-a992-4fe7-b866-e23043ef2e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:11.635897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf54ba-a992-4fe7-b866-e23043ef2e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:11.637322 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf54ba-a992-4fe7-b866-e23043ef2e9f service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:11.647861 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1094/2174] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:52:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:52:13.138829 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d0867-8f34-4c0d-bb7a-a7f6540b1568 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:13.140284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5b0d0867-8f34-4c0d-bb7a-a7f6540b1568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:13.151962 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d0867-8f34-4c0d-bb7a-a7f6540b1568 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:13.155592 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30152261-4a4a-429c-b688-d6d9c34bc80f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:13.156222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30152261-4a4a-429c-b688-d6d9c34bc80f service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:13.156503 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30152261-4a4a-429c-b688-d6d9c34bc80f service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:13.156774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30152261-4a4a-429c-b688-d6d9c34bc80f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:13.213393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30152261-4a4a-429c-b688-d6d9c34bc80f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:13.214850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30152261-4a4a-429c-b688-d6d9c34bc80f service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:13.223543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1081/2175] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:52:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:52:13.336806 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf54ba-a992-4fe7-b866-e23043ef2e9f service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:13.338244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-31cf54ba-a992-4fe7-b866-e23043ef2e9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:13.409144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf54ba-a992-4fe7-b866-e23043ef2e9f service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:13.416289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:13.417221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:13.417511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:13.417777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] PATH_INFO: `/v3/users/ed36e6a9ae0b48e99c904298c76fd19c` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:13.419051 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed36e6a9ae0b48e99c904298c76fd19c)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:13.421377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:13.491356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed36e6a9ae0b48e99c904298c76fd19c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:13.504375 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed36e6a9ae0b48e99c904298c76fd19c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:13.505176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed36e6a9ae0b48e99c904298c76fd19c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:13.505818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed36e6a9ae0b48e99c904298c76fd19c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:13.513572 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed36e6a9ae0b48e99c904298c76fd19c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:13.526841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1095/2176] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:52:13 2022] DELETE /identity/v3/users/ed36e6a9ae0b48e99c904298c76fd19c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:13.531376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9d21c-0122-4dd8-93f1-006f882e70d5 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:13.531667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9d21c-0122-4dd8-93f1-006f882e70d5 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:13.532234 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9d21c-0122-4dd8-93f1-006f882e70d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:13.554039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ced9d21c-0122-4dd8-93f1-006f882e70d5 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:13.555499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ced9d21c-0122-4dd8-93f1-006f882e70d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:13.643540 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1082/2177] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:13.657083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:13.659402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:13.754121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae21c-856a-44a6-aaed-8783595fee97 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:13.759950 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b337037-0655-4de5-a3db-3b9bb6ae7c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:13.761046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b337037-0655-4de5-a3db-3b9bb6ae7c5b service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:13.761495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b337037-0655-4de5-a3db-3b9bb6ae7c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:13.762123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b337037-0655-4de5-a3db-3b9bb6ae7c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:13.784781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b337037-0655-4de5-a3db-3b9bb6ae7c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:13.786232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b337037-0655-4de5-a3db-3b9bb6ae7c5b service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:13.807169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1096/2178] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:52:13.950215 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9d21c-0122-4dd8-93f1-006f882e70d5 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:13.951847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ced9d21c-0122-4dd8-93f1-006f882e70d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:14.035355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9d21c-0122-4dd8-93f1-006f882e70d5 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:14.040072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6545d-de31-4e8a-a266-7488e3bb2f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:14.040688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6545d-de31-4e8a-a266-7488e3bb2f65 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:14.041072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6545d-de31-4e8a-a266-7488e3bb2f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:14.041248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6545d-de31-4e8a-a266-7488e3bb2f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:14.043646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b1f6545d-de31-4e8a-a266-7488e3bb2f65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:14.126099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6545d-de31-4e8a-a266-7488e3bb2f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:14.127656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6545d-de31-4e8a-a266-7488e3bb2f65 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:14.138858 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1083/2179] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:52:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:52:14.174199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b337037-0655-4de5-a3db-3b9bb6ae7c5b service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:14.175776 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7b337037-0655-4de5-a3db-3b9bb6ae7c5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:14.190368 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b337037-0655-4de5-a3db-3b9bb6ae7c5b service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:14.197717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:14.198963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:14.199371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:14.199795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] PATH_INFO: `/v3/projects/c50d182a98ba4d81aa9254a76c9a9fa4` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:14.202472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c50d182a98ba4d81aa9254a76c9a9fa4)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:14.204577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:14.262821 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c50d182a98ba4d81aa9254a76c9a9fa4', 'request_id': 'req-1e118f88-9d05-4043-8188-1324e7ae6da2'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:14.269291 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c50d182a98ba4d81aa9254a76c9a9fa4', 'request_id': 'req-1e118f88-9d05-4043-8188-1324e7ae6da2'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:14.283180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c50d182a98ba4d81aa9254a76c9a9fa4', 'request_id': 'req-1e118f88-9d05-4043-8188-1324e7ae6da2'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:14.296196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] The token cache is being invalidate because project c50d182a98ba4d81aa9254a76c9a9fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:52:14.296685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:14.297351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1e118f88-9d05-4043-8188-1324e7ae6da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:14.299638 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1097/2180] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:52:14 2022] DELETE /identity/v3/projects/c50d182a98ba4d81aa9254a76c9a9fa4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:18.087260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6545d-de31-4e8a-a266-7488e3bb2f65 service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:18.088918 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b1f6545d-de31-4e8a-a266-7488e3bb2f65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:18.103546 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6545d-de31-4e8a-a266-7488e3bb2f65 service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:18.161910 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:18.163334 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:18.163609 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:18.163878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] PATH_INFO: `/v3/users/3814a41f27cc464a87e15c3595e58a64` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:18.165090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3814a41f27cc464a87e15c3595e58a64)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:18.167112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:18.217544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3814a41f27cc464a87e15c3595e58a64'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.225720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3814a41f27cc464a87e15c3595e58a64'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.233144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3814a41f27cc464a87e15c3595e58a64'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.245669 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3814a41f27cc464a87e15c3595e58a64'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.246284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3814a41f27cc464a87e15c3595e58a64'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.252289 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1084/2181] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:52:18 2022] DELETE /identity/v3/users/3814a41f27cc464a87e15c3595e58a64 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:18.256900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437831c5-76d7-4383-8ee7-a3bac2c5ffdc None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:18.257369 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437831c5-76d7-4383-8ee7-a3bac2c5ffdc None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:18.257568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437831c5-76d7-4383-8ee7-a3bac2c5ffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:18.276008 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-437831c5-76d7-4383-8ee7-a3bac2c5ffdc None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:18.277202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-437831c5-76d7-4383-8ee7-a3bac2c5ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:18.334942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1098/2182] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:18.344526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:18.345933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:18.403045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43375c3-3772-42f9-aabf-c215d16bdc78 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:18.406875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21830a-b6eb-49a8-8a5a-8ce584452458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:18.407514 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21830a-b6eb-49a8-8a5a-8ce584452458 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:18.407795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21830a-b6eb-49a8-8a5a-8ce584452458 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:18.408135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21830a-b6eb-49a8-8a5a-8ce584452458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:18.417853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21830a-b6eb-49a8-8a5a-8ce584452458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:18.419327 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21830a-b6eb-49a8-8a5a-8ce584452458 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:18.429240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1085/2183] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:52:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:52:18.691250 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437831c5-76d7-4383-8ee7-a3bac2c5ffdc None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:18.692761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-437831c5-76d7-4383-8ee7-a3bac2c5ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:18.704832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437831c5-76d7-4383-8ee7-a3bac2c5ffdc None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:18.709460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:18.710325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:18.710582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:18.710893 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] PATH_INFO: `/v3/projects/9ac8c04d48da4518966fd498b1aa9297` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:18.712092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac8c04d48da4518966fd498b1aa9297)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:18.713982 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:18.762728 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac8c04d48da4518966fd498b1aa9297', 'request_id': 'req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.768341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac8c04d48da4518966fd498b1aa9297', 'request_id': 'req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.778033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac8c04d48da4518966fd498b1aa9297', 'request_id': 'req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.790023 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] The token cache is being invalidate because project 9ac8c04d48da4518966fd498b1aa9297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:52:18.790315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.790996 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.792544 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1099/2184] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:52:18 2022] DELETE /identity/v3/projects/9ac8c04d48da4518966fd498b1aa9297 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:52:18.796493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21830a-b6eb-49a8-8a5a-8ce584452458 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:18.806712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21830a-b6eb-49a8-8a5a-8ce584452458 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:18.861798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:18.862667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:18.862989 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:18.863261 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] PATH_INFO: `/v3/users/aa2822ec81fc430ebdb491eddcfb36bf` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:18.864455 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2822ec81fc430ebdb491eddcfb36bf)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:18.866958 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:18.916981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2822ec81fc430ebdb491eddcfb36bf'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.927210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2822ec81fc430ebdb491eddcfb36bf'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.946429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2822ec81fc430ebdb491eddcfb36bf'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.952428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2822ec81fc430ebdb491eddcfb36bf'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.953727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2822ec81fc430ebdb491eddcfb36bf'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:18.960305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1086/2185] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:52:18 2022] DELETE /identity/v3/users/aa2822ec81fc430ebdb491eddcfb36bf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:19.266179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:19.268503 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:19.286728 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a83bdc-83ec-41bb-a2d6-8cc192bd8b36 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:19.362727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:19.363735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:19.364024 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:19.364314 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] PATH_INFO: `/v3/projects/6f6526ce25cc4146ab6973e250a66d7a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:19.366210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6526ce25cc4146ab6973e250a66d7a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:19.369015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:19.422840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6526ce25cc4146ab6973e250a66d7a', 'request_id': 'req-97a08634-ee09-4d70-9487-48f9776e6de7'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:19.435251 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6526ce25cc4146ab6973e250a66d7a', 'request_id': 'req-97a08634-ee09-4d70-9487-48f9776e6de7'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:19.447421 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6526ce25cc4146ab6973e250a66d7a', 'request_id': 'req-97a08634-ee09-4d70-9487-48f9776e6de7'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:19.462294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] The token cache is being invalidate because project 6f6526ce25cc4146ab6973e250a66d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:52:19.462611 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:19.463308 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:19.467733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1100/2186] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:52:19 2022] DELETE /identity/v3/projects/6f6526ce25cc4146ab6973e250a66d7a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:19.468965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:19.470419 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:19.483782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456263a-b083-463e-ab0d-6ea8f8f0f586 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:19.542942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9cc70-97b5-40c6-956b-dd96a6862be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:19.543814 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9cc70-97b5-40c6-956b-dd96a6862be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:19.544098 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9cc70-97b5-40c6-956b-dd96a6862be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:19.544391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9cc70-97b5-40c6-956b-dd96a6862be6 admin admin] PATH_INFO: `/v3/users/c480bb8ff5f84af6b175adc012cbab16` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:19.545575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9cc70-97b5-40c6-956b-dd96a6862be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c480bb8ff5f84af6b175adc012cbab16)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:19.547566 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9cc70-97b5-40c6-956b-dd96a6862be6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:19.591600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d6f9cc70-97b5-40c6-956b-dd96a6862be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c480bb8ff5f84af6b175adc012cbab16'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:19.599528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d6f9cc70-97b5-40c6-956b-dd96a6862be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c480bb8ff5f84af6b175adc012cbab16'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:19.606660 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d6f9cc70-97b5-40c6-956b-dd96a6862be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c480bb8ff5f84af6b175adc012cbab16'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:19.618942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d6f9cc70-97b5-40c6-956b-dd96a6862be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c480bb8ff5f84af6b175adc012cbab16'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:19.619589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d6f9cc70-97b5-40c6-956b-dd96a6862be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c480bb8ff5f84af6b175adc012cbab16'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:19.625249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1087/2187] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:52:19 2022] DELETE /identity/v3/users/c480bb8ff5f84af6b175adc012cbab16 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:19.887323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:19.888829 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:19.902181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08634-ee09-4d70-9487-48f9776e6de7 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:19.958323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:19.959252 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:19.959581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:19.959860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] PATH_INFO: `/v3/projects/37e206d574884ea797cbe418b6d03995` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:19.961097 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37e206d574884ea797cbe418b6d03995)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:19.963035 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:20.022558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e206d574884ea797cbe418b6d03995', 'request_id': 'req-2613e8af-7cdb-4694-8da6-923ce324f587'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:20.027910 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e206d574884ea797cbe418b6d03995', 'request_id': 'req-2613e8af-7cdb-4694-8da6-923ce324f587'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:20.034864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e206d574884ea797cbe418b6d03995', 'request_id': 'req-2613e8af-7cdb-4694-8da6-923ce324f587'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:20.046005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] The token cache is being invalidate because project 37e206d574884ea797cbe418b6d03995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:52:20.046241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:20.046887 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-2613e8af-7cdb-4694-8da6-923ce324f587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:20.048406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1101/2188] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:52:19 2022] DELETE /identity/v3/projects/37e206d574884ea797cbe418b6d03995 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:52:20.054732 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaaa15-41a6-4c73-8d3a-28fbfe67e91e None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:20.055070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaaa15-41a6-4c73-8d3a-28fbfe67e91e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:20.055355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaaa15-41a6-4c73-8d3a-28fbfe67e91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:20.074152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-04eaaa15-41a6-4c73-8d3a-28fbfe67e91e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:20.075387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-04eaaa15-41a6-4c73-8d3a-28fbfe67e91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:20.131639 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1088/2189] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:52:20.139601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e3359-d506-4bf5-9104-a4c074140413 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:20.139892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e3359-d506-4bf5-9104-a4c074140413 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:20.140172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e3359-d506-4bf5-9104-a4c074140413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:20.160721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ad8e3359-d506-4bf5-9104-a4c074140413 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:20.161954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ad8e3359-d506-4bf5-9104-a4c074140413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:20.178083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1102/2190] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:20.188126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaaa15-41a6-4c73-8d3a-28fbfe67e91e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:20.205766 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaaa15-41a6-4c73-8d3a-28fbfe67e91e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:20.212562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e0d1c-2ba2-4e16-b71d-5659629119a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:20.213425 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0d1c-2ba2-4e16-b71d-5659629119a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:20.213860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0d1c-2ba2-4e16-b71d-5659629119a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:20.214284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0d1c-2ba2-4e16-b71d-5659629119a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:20.215209 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e0d1c-2ba2-4e16-b71d-5659629119a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:52:20.215667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e0d1c-2ba2-4e16-b71d-5659629119a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:20.217277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e0d1c-2ba2-4e16-b71d-5659629119a4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:20.233485 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1089/2191] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:52:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:52:20.238142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e3359-d506-4bf5-9104-a4c074140413 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:20.257757 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e3359-d506-4bf5-9104-a4c074140413 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:20.263120 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a2832-f0f5-43d3-bb00-b66358006be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:20.263886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a2832-f0f5-43d3-bb00-b66358006be8 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:20.264442 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a2832-f0f5-43d3-bb00-b66358006be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:20.264843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a2832-f0f5-43d3-bb00-b66358006be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:20.265658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a2832-f0f5-43d3-bb00-b66358006be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:20.267684 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a2832-f0f5-43d3-bb00-b66358006be8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:20.298847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1103/2192] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:52:20 2022] POST /identity/v3/projects => generated 384 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:52:20.302121 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e0d1c-2ba2-4e16-b71d-5659629119a4 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:20.313063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e0d1c-2ba2-4e16-b71d-5659629119a4 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:20.376948 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498f895-0444-402d-9477-6e433815caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:20.377624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498f895-0444-402d-9477-6e433815caae admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:20.377912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498f895-0444-402d-9477-6e433815caae admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:20.378190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498f895-0444-402d-9477-6e433815caae admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:20.378953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498f895-0444-402d-9477-6e433815caae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:20.381391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498f895-0444-402d-9477-6e433815caae admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:20.401780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1090/2193] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:52:20 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:52:20.405872 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a2832-f0f5-43d3-bb00-b66358006be8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:20.416198 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a2832-f0f5-43d3-bb00-b66358006be8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:20.420846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4188e-f31e-4748-b7fb-690a1cc4970a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:20.421490 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4188e-f31e-4748-b7fb-690a1cc4970a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:20.421774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4188e-f31e-4748-b7fb-690a1cc4970a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:20.422051 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4188e-f31e-4748-b7fb-690a1cc4970a admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:20.422863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4188e-f31e-4748-b7fb-690a1cc4970a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:20.424450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4188e-f31e-4748-b7fb-690a1cc4970a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:20.436152 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1104/2194] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:52:20 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:52:20.440269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498f895-0444-402d-9477-6e433815caae admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:20.451245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498f895-0444-402d-9477-6e433815caae admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:20.456003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf66530-0d3d-4bfc-80ef-7c245cf7c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:20.456653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf66530-0d3d-4bfc-80ef-7c245cf7c307 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:20.456933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf66530-0d3d-4bfc-80ef-7c245cf7c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:20.457207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf66530-0d3d-4bfc-80ef-7c245cf7c307 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:20.457943 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf66530-0d3d-4bfc-80ef-7c245cf7c307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:20.460373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf66530-0d3d-4bfc-80ef-7c245cf7c307 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:20.469931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1091/2195] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:52:20 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:52:20.474157 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4188e-f31e-4748-b7fb-690a1cc4970a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:20.484342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4188e-f31e-4748-b7fb-690a1cc4970a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:20.489051 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80cf0f-ce63-426a-ab7a-18ffdf61147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:20.489923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80cf0f-ce63-426a-ab7a-18ffdf61147d admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:20.490310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80cf0f-ce63-426a-ab7a-18ffdf61147d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:20.490594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80cf0f-ce63-426a-ab7a-18ffdf61147d admin admin] PATH_INFO: `/v3/projects/772de9e75506447b87526f3e1f2cf34f/users/43bca89ee28143d780d350c37b3af65c/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:20.504679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80cf0f-ce63-426a-ab7a-18ffdf61147d admin admin] RBAC: Authorizing `identity:create_grant(project_id=772de9e75506447b87526f3e1f2cf34f, user_id=43bca89ee28143d780d350c37b3af65c, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:20.507922 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80cf0f-ce63-426a-ab7a-18ffdf61147d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:20.520378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1105/2196] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:52:20 2022] PUT /identity/v3/projects/772de9e75506447b87526f3e1f2cf34f/users/43bca89ee28143d780d350c37b3af65c/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:20.526210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b94620-66df-412d-8d6f-d5d20378518a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:20.526500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b94620-66df-412d-8d6f-d5d20378518a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:20.526801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b94620-66df-412d-8d6f-d5d20378518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:20.544611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-06b94620-66df-412d-8d6f-d5d20378518a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:20.545815 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-06b94620-66df-412d-8d6f-d5d20378518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:20.604092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1092/2197] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:20.613520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80cf0f-ce63-426a-ab7a-18ffdf61147d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:20.615294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5f80cf0f-ce63-426a-ab7a-18ffdf61147d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:20.671203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80cf0f-ce63-426a-ab7a-18ffdf61147d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:20.674946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ad433-de6c-4848-be08-57e6b00aa2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:20.675585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ad433-de6c-4848-be08-57e6b00aa2cd service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:20.675868 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ad433-de6c-4848-be08-57e6b00aa2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:20.676142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ad433-de6c-4848-be08-57e6b00aa2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:20.686074 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ad433-de6c-4848-be08-57e6b00aa2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:20.687791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ad433-de6c-4848-be08-57e6b00aa2cd service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:20.697840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1106/2198] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:52:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:52:21.320551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97620c-f22e-4474-8fe1-03cb334aaeb6 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:21.320847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97620c-f22e-4474-8fe1-03cb334aaeb6 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:21.321298 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97620c-f22e-4474-8fe1-03cb334aaeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:21.363355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ca97620c-f22e-4474-8fe1-03cb334aaeb6 None None] MFA Rules not processed for user `43bca89ee28143d780d350c37b3af65c`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:21.364573 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ca97620c-f22e-4474-8fe1-03cb334aaeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:21.451474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1093/2199] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:52:21.461826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ad433-de6c-4848-be08-57e6b00aa2cd service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:21.463673 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c39ad433-de6c-4848-be08-57e6b00aa2cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:21.554067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ad433-de6c-4848-be08-57e6b00aa2cd service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:21.561597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67a1dd-6b78-4652-b3d6-6773e26cc3ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:21.562504 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67a1dd-6b78-4652-b3d6-6773e26cc3ee service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:21.562844 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67a1dd-6b78-4652-b3d6-6773e26cc3ee service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:21.563126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67a1dd-6b78-4652-b3d6-6773e26cc3ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:21.572909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67a1dd-6b78-4652-b3d6-6773e26cc3ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:21.574574 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67a1dd-6b78-4652-b3d6-6773e26cc3ee service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:21.587918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1107/2200] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:52:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:52:23.025113 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ad534-aa59-4f59-a510-2fda0eaff883 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:23.025654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ad534-aa59-4f59-a510-2fda0eaff883 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:23.025654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ad534-aa59-4f59-a510-2fda0eaff883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:23.042638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7b4ad534-aa59-4f59-a510-2fda0eaff883 None None] MFA Rules not processed for user `43bca89ee28143d780d350c37b3af65c`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:23.043872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7b4ad534-aa59-4f59-a510-2fda0eaff883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:23.050677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1094/2201] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:27.751759 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a702a-0b6c-4dad-ac24-29bc9c0ff133 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:27.752263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a702a-0b6c-4dad-ac24-29bc9c0ff133 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:27.752472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a702a-0b6c-4dad-ac24-29bc9c0ff133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:27.773541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-de4a702a-0b6c-4dad-ac24-29bc9c0ff133 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:27.774813 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-de4a702a-0b6c-4dad-ac24-29bc9c0ff133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:27.838499 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1108/2202] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:52:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:27.892490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ad534-aa59-4f59-a510-2fda0eaff883 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:27.896506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7b4ad534-aa59-4f59-a510-2fda0eaff883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:27.999204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ad534-aa59-4f59-a510-2fda0eaff883 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:28.004606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb1927-e871-4766-bb30-7a018184c6db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:28.005260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb1927-e871-4766-bb30-7a018184c6db service swift] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:28.005594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb1927-e871-4766-bb30-7a018184c6db service swift] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:28.005865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb1927-e871-4766-bb30-7a018184c6db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:28.014586 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb1927-e871-4766-bb30-7a018184c6db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:28.016409 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb1927-e871-4766-bb30-7a018184c6db service swift] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:28.034799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1095/2203] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:52:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:52:30.142303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15f7a-f845-4347-bb43-13c8f84fee83 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:30.143325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15f7a-f845-4347-bb43-13c8f84fee83 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:30.143325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15f7a-f845-4347-bb43-13c8f84fee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:30.163807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4bc15f7a-f845-4347-bb43-13c8f84fee83 None None] MFA Rules not processed for user `feb8ddf0abd84c1caed8501c57b56f20`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:30.164942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4bc15f7a-f845-4347-bb43-13c8f84fee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:30.226421 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1109/2204] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:31.566297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb1927-e871-4766-bb30-7a018184c6db service swift] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:31.568606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a1eb1927-e871-4766-bb30-7a018184c6db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:31.587780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb1927-e871-4766-bb30-7a018184c6db service swift] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:31.593892 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:31.595235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:31.595621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:31.595997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] PATH_INFO: `/v3/users/a6b23a71c07b44a9a68748815dbee5bd` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:31.597403 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b23a71c07b44a9a68748815dbee5bd)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:31.600315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:31.728724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b23a71c07b44a9a68748815dbee5bd'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:31.743263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b23a71c07b44a9a68748815dbee5bd'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:31.761264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b23a71c07b44a9a68748815dbee5bd'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:31.781830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b23a71c07b44a9a68748815dbee5bd'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:31.783250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b23a71c07b44a9a68748815dbee5bd'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:31.798197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1096/2205] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:52:31 2022] DELETE /identity/v3/users/a6b23a71c07b44a9a68748815dbee5bd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:31.802699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c07e-976c-4a70-b62c-95d47bbbf348 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:31.803273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c07e-976c-4a70-b62c-95d47bbbf348 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:31.803376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c07e-976c-4a70-b62c-95d47bbbf348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:31.825237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-cf34c07e-976c-4a70-b62c-95d47bbbf348 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:31.826618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-cf34c07e-976c-4a70-b62c-95d47bbbf348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:31.935906 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1110/2206] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:31.947244 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:31.948937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:32.037393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ca90e-5ee8-424d-ab95-13d8f75ec998 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:32.042526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660e10d-1a03-45d5-972a-7626102b66e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:32.043432 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660e10d-1a03-45d5-972a-7626102b66e5 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:32.044037 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660e10d-1a03-45d5-972a-7626102b66e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:32.045122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660e10d-1a03-45d5-972a-7626102b66e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:32.058136 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660e10d-1a03-45d5-972a-7626102b66e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:32.060016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660e10d-1a03-45d5-972a-7626102b66e5 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:32.078546 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1097/2207] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:52:32.563096 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c07e-976c-4a70-b62c-95d47bbbf348 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:32.564845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-cf34c07e-976c-4a70-b62c-95d47bbbf348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:32.579472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c07e-976c-4a70-b62c-95d47bbbf348 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:32.587379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:32.588595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:32.589077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:32.589547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] PATH_INFO: `/v3/projects/1f4225946c604cf883be3773d3cac2c9` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:32.591134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4225946c604cf883be3773d3cac2c9)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:32.593463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:32.715787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4225946c604cf883be3773d3cac2c9', 'request_id': 'req-81538754-ed34-40ab-a29b-6894d182edef'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:32.722541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4225946c604cf883be3773d3cac2c9', 'request_id': 'req-81538754-ed34-40ab-a29b-6894d182edef'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:32.744213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4225946c604cf883be3773d3cac2c9', 'request_id': 'req-81538754-ed34-40ab-a29b-6894d182edef'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:32.792085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] The token cache is being invalidate because project 1f4225946c604cf883be3773d3cac2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:52:32.792857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:32.794165 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:32.800027 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1111/2208] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:52:32 2022] DELETE /identity/v3/projects/1f4225946c604cf883be3773d3cac2c9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:56.857212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0de50-5657-4878-b1fa-ca7b5a5e24c2 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:56.857707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0de50-5657-4878-b1fa-ca7b5a5e24c2 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:56.857819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0de50-5657-4878-b1fa-ca7b5a5e24c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:56.884442 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-72f0de50-5657-4878-b1fa-ca7b5a5e24c2 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:56.885619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-72f0de50-5657-4878-b1fa-ca7b5a5e24c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:56.956495 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1098/2209] 10.222.0.117 () {58 vars in 972 bytes} [Mon Jan 24 16:52:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:56.969700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:56.971091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:57.063585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538754-ed34-40ab-a29b-6894d182edef admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:57.068761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f75f7-c097-493b-90fe-eeb6041d4069 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:57.069397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f75f7-c097-493b-90fe-eeb6041d4069 service swift] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:57.069678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f75f7-c097-493b-90fe-eeb6041d4069 service swift] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:57.069991 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f75f7-c097-493b-90fe-eeb6041d4069 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:57.080236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f75f7-c097-493b-90fe-eeb6041d4069 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:57.081831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f75f7-c097-493b-90fe-eeb6041d4069 service swift] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:57.091506 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1112/2210] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:52:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:52:59.025692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0de50-5657-4878-b1fa-ca7b5a5e24c2 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:59.029431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-72f0de50-5657-4878-b1fa-ca7b5a5e24c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:59.144230 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0de50-5657-4878-b1fa-ca7b5a5e24c2 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:59.155543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80479ef-5b3a-40ff-8b00-d06fba6e1292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:59.156438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80479ef-5b3a-40ff-8b00-d06fba6e1292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:59.156724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80479ef-5b3a-40ff-8b00-d06fba6e1292 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:59.157004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80479ef-5b3a-40ff-8b00-d06fba6e1292 admin admin] PATH_INFO: `/v3/users/54f058a8f1014fde9d4ec742e8174d00` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:59.158708 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80479ef-5b3a-40ff-8b00-d06fba6e1292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f058a8f1014fde9d4ec742e8174d00)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:59.160691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80479ef-5b3a-40ff-8b00-d06fba6e1292 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:59.206596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a80479ef-5b3a-40ff-8b00-d06fba6e1292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f058a8f1014fde9d4ec742e8174d00'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:59.213890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a80479ef-5b3a-40ff-8b00-d06fba6e1292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f058a8f1014fde9d4ec742e8174d00'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:59.220592 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a80479ef-5b3a-40ff-8b00-d06fba6e1292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f058a8f1014fde9d4ec742e8174d00'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:59.232322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a80479ef-5b3a-40ff-8b00-d06fba6e1292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f058a8f1014fde9d4ec742e8174d00'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:59.232983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a80479ef-5b3a-40ff-8b00-d06fba6e1292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f058a8f1014fde9d4ec742e8174d00'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:59.238778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1099/2211] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:52:59 2022] DELETE /identity/v3/users/54f058a8f1014fde9d4ec742e8174d00 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:59.409378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f75f7-c097-493b-90fe-eeb6041d4069 service swift] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:59.431556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f75f7-c097-493b-90fe-eeb6041d4069 service swift] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:59.519229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:59.520095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:59.520379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:59.520656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] PATH_INFO: `/v3/projects/e5e86d82e0524fd380e44df98739cfa3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:59.521876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e86d82e0524fd380e44df98739cfa3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:59.524724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:59.574770 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e86d82e0524fd380e44df98739cfa3', 'request_id': 'req-dbd2827c-bf98-40ba-922b-2def6eca776c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:59.580154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e86d82e0524fd380e44df98739cfa3', 'request_id': 'req-dbd2827c-bf98-40ba-922b-2def6eca776c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:59.587770 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e86d82e0524fd380e44df98739cfa3', 'request_id': 'req-dbd2827c-bf98-40ba-922b-2def6eca776c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:59.598652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] The token cache is being invalidate because project e5e86d82e0524fd380e44df98739cfa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:52:59.598976 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:59.599618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-dbd2827c-bf98-40ba-922b-2def6eca776c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:52:59.601437 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1113/2212] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:52:59 2022] DELETE /identity/v3/projects/e5e86d82e0524fd380e44df98739cfa3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:52:59.607007 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c7ba-e022-40eb-a3d0-1036cbce3755 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:59.607406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c7ba-e022-40eb-a3d0-1036cbce3755 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:59.607757 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c7ba-e022-40eb-a3d0-1036cbce3755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:59.655665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ff00c7ba-e022-40eb-a3d0-1036cbce3755 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:59.656794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ff00c7ba-e022-40eb-a3d0-1036cbce3755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:59.716490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1100/2213] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:52:59.724158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184ead8-abdd-476a-b19b-2501844c4b07 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:59.724446 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184ead8-abdd-476a-b19b-2501844c4b07 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:59.724726 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184ead8-abdd-476a-b19b-2501844c4b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:59.743745 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b184ead8-abdd-476a-b19b-2501844c4b07 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:52:59.744952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b184ead8-abdd-476a-b19b-2501844c4b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:52:59.753018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1114/2214] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:52:59.757332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00c7ba-e022-40eb-a3d0-1036cbce3755 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:59.768113 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00c7ba-e022-40eb-a3d0-1036cbce3755 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:59.772776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c849865-1810-4784-a871-9d4b932dd198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:59.774988 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c849865-1810-4784-a871-9d4b932dd198 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:59.774988 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c849865-1810-4784-a871-9d4b932dd198 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:59.774988 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c849865-1810-4784-a871-9d4b932dd198 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:59.775463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c849865-1810-4784-a871-9d4b932dd198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:52:59.775756 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c849865-1810-4784-a871-9d4b932dd198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:59.777380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c849865-1810-4784-a871-9d4b932dd198 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:59.794831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1101/2215] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:52:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:52:59.796616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184ead8-abdd-476a-b19b-2501844c4b07 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:59.809555 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184ead8-abdd-476a-b19b-2501844c4b07 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:59.814514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e5b0-c719-48d2-ad48-698cd1c36ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:59.815200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e5b0-c719-48d2-ad48-698cd1c36ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:59.815482 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e5b0-c719-48d2-ad48-698cd1c36ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:59.815776 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e5b0-c719-48d2-ad48-698cd1c36ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:59.816465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e5b0-c719-48d2-ad48-698cd1c36ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:59.818412 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e5b0-c719-48d2-ad48-698cd1c36ad3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:59.846635 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1115/2216] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:52:59 2022] POST /identity/v3/projects => generated 384 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:52:59.850726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c849865-1810-4784-a871-9d4b932dd198 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:59.860536 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c849865-1810-4784-a871-9d4b932dd198 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:59.916174 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d753ecc-797c-4e4b-9c67-d7cb6f78ab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:59.916760 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d753ecc-797c-4e4b-9c67-d7cb6f78ab2f admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:59.917046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d753ecc-797c-4e4b-9c67-d7cb6f78ab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:59.917323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d753ecc-797c-4e4b-9c67-d7cb6f78ab2f admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:59.918019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d753ecc-797c-4e4b-9c67-d7cb6f78ab2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:59.919957 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d753ecc-797c-4e4b-9c67-d7cb6f78ab2f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:59.939664 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1102/2217] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:52:59 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:52:59.943831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e5b0-c719-48d2-ad48-698cd1c36ad3 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:59.954637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e5b0-c719-48d2-ad48-698cd1c36ad3 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:59.959513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f917fe-5f1e-4086-9407-7d2aadc577dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:59.960164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f917fe-5f1e-4086-9407-7d2aadc577dd admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:59.960447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f917fe-5f1e-4086-9407-7d2aadc577dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:59.961434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f917fe-5f1e-4086-9407-7d2aadc577dd admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:59.962262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f917fe-5f1e-4086-9407-7d2aadc577dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:59.963870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f917fe-5f1e-4086-9407-7d2aadc577dd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:52:59.973902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1116/2218] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:52:59 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:52:59.977949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d753ecc-797c-4e4b-9c67-d7cb6f78ab2f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:52:59.987718 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d753ecc-797c-4e4b-9c67-d7cb6f78ab2f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:52:59.992547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a853b-c407-46f1-948c-f83a65f8c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:52:59.993191 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a853b-c407-46f1-948c-f83a65f8c84a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:52:59.993472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a853b-c407-46f1-948c-f83a65f8c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:52:59.993768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a853b-c407-46f1-948c-f83a65f8c84a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:52:59.994505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a853b-c407-46f1-948c-f83a65f8c84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:52:59.996130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a853b-c407-46f1-948c-f83a65f8c84a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:00.006019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1103/2219] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:52:59 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:53:00.010596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f917fe-5f1e-4086-9407-7d2aadc577dd admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:00.020365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f917fe-5f1e-4086-9407-7d2aadc577dd admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:00.025694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ace102-f7fc-4454-aa6a-d169ca6e6fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:00.026562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ace102-f7fc-4454-aa6a-d169ca6e6fac admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:00.026903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ace102-f7fc-4454-aa6a-d169ca6e6fac admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:00.027182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ace102-f7fc-4454-aa6a-d169ca6e6fac admin admin] PATH_INFO: `/v3/projects/2331f54a18fb421586102da88ee385f7/users/9408d7532d704787a80de813832a0e6a/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:00.041371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ace102-f7fc-4454-aa6a-d169ca6e6fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2331f54a18fb421586102da88ee385f7, user_id=9408d7532d704787a80de813832a0e6a, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:00.044032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ace102-f7fc-4454-aa6a-d169ca6e6fac admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:00.057017 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1117/2220] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:53:00 2022] PUT /identity/v3/projects/2331f54a18fb421586102da88ee385f7/users/9408d7532d704787a80de813832a0e6a/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:53:00.067300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d858d-ed5d-4237-9f16-b6db364efce5 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:00.067758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d858d-ed5d-4237-9f16-b6db364efce5 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:00.067879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d858d-ed5d-4237-9f16-b6db364efce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:00.095232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-362d858d-ed5d-4237-9f16-b6db364efce5 None None] MFA Rules not processed for user `9408d7532d704787a80de813832a0e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:00.096463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-362d858d-ed5d-4237-9f16-b6db364efce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:00.162578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1104/2221] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:00.173164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ace102-f7fc-4454-aa6a-d169ca6e6fac admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:00.175095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b0ace102-f7fc-4454-aa6a-d169ca6e6fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:00.233156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ace102-f7fc-4454-aa6a-d169ca6e6fac admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:00.236810 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d220c-115c-489a-b8d7-ae2310e17b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:00.237441 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d220c-115c-489a-b8d7-ae2310e17b4f service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:00.237719 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d220c-115c-489a-b8d7-ae2310e17b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:00.237994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d220c-115c-489a-b8d7-ae2310e17b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:00.246575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d220c-115c-489a-b8d7-ae2310e17b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:00.248026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d220c-115c-489a-b8d7-ae2310e17b4f service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:00.257483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1118/2222] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:53:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:53:02.784027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d858d-ed5d-4237-9f16-b6db364efce5 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:02.849613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d858d-ed5d-4237-9f16-b6db364efce5 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:02.855115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:02.856510 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:02.856798 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:02.857074 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] PATH_INFO: `/v3/users/9408d7532d704787a80de813832a0e6a` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:02.858324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9408d7532d704787a80de813832a0e6a)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:02.860276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:02.906069 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9408d7532d704787a80de813832a0e6a'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:02.913247 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9408d7532d704787a80de813832a0e6a'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:02.920723 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9408d7532d704787a80de813832a0e6a'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:02.932747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9408d7532d704787a80de813832a0e6a'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:02.933732 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9408d7532d704787a80de813832a0e6a'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:02.940912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1105/2223] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:53:02 2022] DELETE /identity/v3/users/9408d7532d704787a80de813832a0e6a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:53:02.949753 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697a8f-dc6e-4443-85c1-4336d9ebb78e None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:02.950243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697a8f-dc6e-4443-85c1-4336d9ebb78e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:02.950323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697a8f-dc6e-4443-85c1-4336d9ebb78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:02.980378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-54697a8f-dc6e-4443-85c1-4336d9ebb78e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:02.981578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-54697a8f-dc6e-4443-85c1-4336d9ebb78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:03.045019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1119/2224] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:03.054957 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:03.056646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:03.152275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacae74-e970-491c-a414-dc74845409b1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:03.152275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6f860-2bab-4186-9599-b34efad380ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:03.152275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6f860-2bab-4186-9599-b34efad380ce service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:03.152275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6f860-2bab-4186-9599-b34efad380ce service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:03.152769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6f860-2bab-4186-9599-b34efad380ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:03.162256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6f860-2bab-4186-9599-b34efad380ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:03.163949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6f860-2bab-4186-9599-b34efad380ce service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:03.173956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1106/2225] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:53:03.436202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697a8f-dc6e-4443-85c1-4336d9ebb78e None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:03.437655 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-54697a8f-dc6e-4443-85c1-4336d9ebb78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:03.452824 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697a8f-dc6e-4443-85c1-4336d9ebb78e None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:03.459030 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:03.460106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:03.460559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:03.460711 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] PATH_INFO: `/v3/projects/2331f54a18fb421586102da88ee385f7` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:03.461997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2331f54a18fb421586102da88ee385f7)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:03.463960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:03.511630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2331f54a18fb421586102da88ee385f7', 'request_id': 'req-b74c9c23-20fa-44d1-b1fc-a928e39a197b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:03.517610 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2331f54a18fb421586102da88ee385f7', 'request_id': 'req-b74c9c23-20fa-44d1-b1fc-a928e39a197b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:03.525213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2331f54a18fb421586102da88ee385f7', 'request_id': 'req-b74c9c23-20fa-44d1-b1fc-a928e39a197b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:03.536366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] The token cache is being invalidate because project 2331f54a18fb421586102da88ee385f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:53:03.536668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:03.537834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b74c9c23-20fa-44d1-b1fc-a928e39a197b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:03.539635 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1120/2226] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:53:03 2022] DELETE /identity/v3/projects/2331f54a18fb421586102da88ee385f7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:53:03.545634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf7708-d403-4899-ae2f-3fe214d7bf5c None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:03.545923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf7708-d403-4899-ae2f-3fe214d7bf5c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:03.546220 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf7708-d403-4899-ae2f-3fe214d7bf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:03.579272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-3bdf7708-d403-4899-ae2f-3fe214d7bf5c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:03.580469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3bdf7708-d403-4899-ae2f-3fe214d7bf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:03.638685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1107/2227] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:03.647689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989dec-4479-4828-bf81-fd96ec22e680 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:03.647985 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989dec-4479-4828-bf81-fd96ec22e680 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:03.648321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989dec-4479-4828-bf81-fd96ec22e680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:03.667330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-28989dec-4479-4828-bf81-fd96ec22e680 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:03.668531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-28989dec-4479-4828-bf81-fd96ec22e680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:03.677707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1121/2228] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:53:03.682543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf7708-d403-4899-ae2f-3fe214d7bf5c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:03.693008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf7708-d403-4899-ae2f-3fe214d7bf5c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:03.698466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff613fcd-aea6-40d4-88e8-d7c5aca69ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:03.699226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff613fcd-aea6-40d4-88e8-d7c5aca69ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:03.699508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff613fcd-aea6-40d4-88e8-d7c5aca69ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:03.699787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff613fcd-aea6-40d4-88e8-d7c5aca69ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:03.700522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff613fcd-aea6-40d4-88e8-d7c5aca69ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:53:03.700832 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff613fcd-aea6-40d4-88e8-d7c5aca69ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:03.702422 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff613fcd-aea6-40d4-88e8-d7c5aca69ec9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:03.713934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1108/2229] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:53:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:53:03.718285 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28989dec-4479-4828-bf81-fd96ec22e680 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:03.728513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28989dec-4479-4828-bf81-fd96ec22e680 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:03.733177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa030d-30e5-4b75-adb6-7a98ede2035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:03.733820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa030d-30e5-4b75-adb6-7a98ede2035c admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:03.734131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa030d-30e5-4b75-adb6-7a98ede2035c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:03.734409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa030d-30e5-4b75-adb6-7a98ede2035c admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:03.735182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa030d-30e5-4b75-adb6-7a98ede2035c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:03.737054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa030d-30e5-4b75-adb6-7a98ede2035c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:03.763613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1122/2230] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:53:03 2022] POST /identity/v3/projects => generated 386 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:53:03.767660 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff613fcd-aea6-40d4-88e8-d7c5aca69ec9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:03.777640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff613fcd-aea6-40d4-88e8-d7c5aca69ec9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:03.839720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099eb52-c771-4f4e-a75f-0d5881cefdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:03.840451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099eb52-c771-4f4e-a75f-0d5881cefdae admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:03.840926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099eb52-c771-4f4e-a75f-0d5881cefdae admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:03.841250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099eb52-c771-4f4e-a75f-0d5881cefdae admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:03.842117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099eb52-c771-4f4e-a75f-0d5881cefdae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:03.844481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099eb52-c771-4f4e-a75f-0d5881cefdae admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:03.872988 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1109/2231] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:53:03 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:53:03.874212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa030d-30e5-4b75-adb6-7a98ede2035c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:03.884715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa030d-30e5-4b75-adb6-7a98ede2035c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:03.889691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfbd75-0966-4ed5-9b87-073a8d0c23a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:03.890519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfbd75-0966-4ed5-9b87-073a8d0c23a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:03.890704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfbd75-0966-4ed5-9b87-073a8d0c23a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:03.891253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfbd75-0966-4ed5-9b87-073a8d0c23a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:03.892119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfbd75-0966-4ed5-9b87-073a8d0c23a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:03.893915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfbd75-0966-4ed5-9b87-073a8d0c23a8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:03.905256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1123/2232] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:53:03 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:53:03.909318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099eb52-c771-4f4e-a75f-0d5881cefdae admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:03.921951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099eb52-c771-4f4e-a75f-0d5881cefdae admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:03.926739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be0e28-1fdc-479e-992d-80f17f2711b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:03.927425 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be0e28-1fdc-479e-992d-80f17f2711b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:03.927766 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be0e28-1fdc-479e-992d-80f17f2711b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:03.927985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be0e28-1fdc-479e-992d-80f17f2711b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:03.928722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be0e28-1fdc-479e-992d-80f17f2711b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:03.931818 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be0e28-1fdc-479e-992d-80f17f2711b3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:03.942275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1110/2233] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:53:03 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:53:03.946542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfbd75-0966-4ed5-9b87-073a8d0c23a8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:03.956739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfbd75-0966-4ed5-9b87-073a8d0c23a8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:03.962201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f4c2f-54a8-479c-ada9-09f4ec006fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:03.963113 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f4c2f-54a8-479c-ada9-09f4ec006fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:03.963424 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f4c2f-54a8-479c-ada9-09f4ec006fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:03.963821 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f4c2f-54a8-479c-ada9-09f4ec006fcc admin admin] PATH_INFO: `/v3/projects/d60ca23ca0784aef8638d92cfdca914f/users/d07e0cd23d0c4f2ab7aba38a564dc693/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:03.979624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f4c2f-54a8-479c-ada9-09f4ec006fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60ca23ca0784aef8638d92cfdca914f, user_id=d07e0cd23d0c4f2ab7aba38a564dc693, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:03.982280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f4c2f-54a8-479c-ada9-09f4ec006fcc admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:03.997544 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1124/2234] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:53:03 2022] PUT /identity/v3/projects/d60ca23ca0784aef8638d92cfdca914f/users/d07e0cd23d0c4f2ab7aba38a564dc693/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:53:04.002560 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0a7be-6f94-45ad-9e83-b8975e2ca640 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:04.002965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0a7be-6f94-45ad-9e83-b8975e2ca640 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:04.003165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0a7be-6f94-45ad-9e83-b8975e2ca640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:04.022198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e3c0a7be-6f94-45ad-9e83-b8975e2ca640 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:04.023623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e3c0a7be-6f94-45ad-9e83-b8975e2ca640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:04.081739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1111/2235] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:04.091989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f4c2f-54a8-479c-ada9-09f4ec006fcc admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:04.093736 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2a5f4c2f-54a8-479c-ada9-09f4ec006fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:04.150357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f4c2f-54a8-479c-ada9-09f4ec006fcc admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:04.156106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af975b-2309-4d2c-8d77-e65ea02a5682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:04.156768 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af975b-2309-4d2c-8d77-e65ea02a5682 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:04.157050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af975b-2309-4d2c-8d77-e65ea02a5682 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:04.157329 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af975b-2309-4d2c-8d77-e65ea02a5682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:04.168371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af975b-2309-4d2c-8d77-e65ea02a5682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:04.170024 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af975b-2309-4d2c-8d77-e65ea02a5682 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:04.180409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1125/2236] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:53:09.295362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d7062-67bb-419c-876b-43b57e8bd007 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:09.296303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d7062-67bb-419c-876b-43b57e8bd007 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:09.296875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d7062-67bb-419c-876b-43b57e8bd007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:09.326901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-367d7062-67bb-419c-876b-43b57e8bd007 None None] MFA Rules not processed for user `d07e0cd23d0c4f2ab7aba38a564dc693`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:09.328025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-367d7062-67bb-419c-876b-43b57e8bd007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:09.396196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1112/2237] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:09.401321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af975b-2309-4d2c-8d77-e65ea02a5682 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:09.411255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af975b-2309-4d2c-8d77-e65ea02a5682 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:09.417354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef163a-0a48-4d59-8631-71400e9cf87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:09.418477 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef163a-0a48-4d59-8631-71400e9cf87c admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:09.418716 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef163a-0a48-4d59-8631-71400e9cf87c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:09.419096 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef163a-0a48-4d59-8631-71400e9cf87c admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:09.419946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef163a-0a48-4d59-8631-71400e9cf87c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:09.422045 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef163a-0a48-4d59-8631-71400e9cf87c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:09.452365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1126/2238] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:53:09 2022] POST /identity/v3/projects => generated 384 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:53:09.456686 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d7062-67bb-419c-876b-43b57e8bd007 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:09.471088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d7062-67bb-419c-876b-43b57e8bd007 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:09.543994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d124a-aadb-44aa-9c3e-dee858e726fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:09.544830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d124a-aadb-44aa-9c3e-dee858e726fe admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:09.545183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d124a-aadb-44aa-9c3e-dee858e726fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:09.545529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d124a-aadb-44aa-9c3e-dee858e726fe admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:09.546321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d124a-aadb-44aa-9c3e-dee858e726fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:09.548329 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d124a-aadb-44aa-9c3e-dee858e726fe admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:09.574649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1113/2239] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:53:09 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:53:09.575918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef163a-0a48-4d59-8631-71400e9cf87c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:09.595913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef163a-0a48-4d59-8631-71400e9cf87c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:09.601223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6856b69-672c-47b1-8dcf-0228fb0295d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:09.602307 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6856b69-672c-47b1-8dcf-0228fb0295d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:09.602658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6856b69-672c-47b1-8dcf-0228fb0295d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:09.603213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6856b69-672c-47b1-8dcf-0228fb0295d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:09.604278 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6856b69-672c-47b1-8dcf-0228fb0295d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:09.606136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6856b69-672c-47b1-8dcf-0228fb0295d6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:09.618543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1127/2240] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:53:09 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:53:09.622881 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d124a-aadb-44aa-9c3e-dee858e726fe admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:09.633941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d124a-aadb-44aa-9c3e-dee858e726fe admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:09.638587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d926fb-1967-4ec7-b58e-c13bc1d8a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:09.639491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d926fb-1967-4ec7-b58e-c13bc1d8a630 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:09.639771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d926fb-1967-4ec7-b58e-c13bc1d8a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:09.640043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d926fb-1967-4ec7-b58e-c13bc1d8a630 admin admin] PATH_INFO: `/v3/projects/280da8b789a04062997d0c9bd25e86e2/users/7f2e905603904018aa70fc922c0a16ed/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:09.654731 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d926fb-1967-4ec7-b58e-c13bc1d8a630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280da8b789a04062997d0c9bd25e86e2, user_id=7f2e905603904018aa70fc922c0a16ed, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:09.657395 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d926fb-1967-4ec7-b58e-c13bc1d8a630 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:09.669985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1114/2241] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:53:09 2022] PUT /identity/v3/projects/280da8b789a04062997d0c9bd25e86e2/users/7f2e905603904018aa70fc922c0a16ed/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:53:09.673874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6856b69-672c-47b1-8dcf-0228fb0295d6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:09.684507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6856b69-672c-47b1-8dcf-0228fb0295d6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:09.743257 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b0292-0172-46a5-b0dd-3d0e88565c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:09.743928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b0292-0172-46a5-b0dd-3d0e88565c44 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:09.744210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b0292-0172-46a5-b0dd-3d0e88565c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:09.744485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b0292-0172-46a5-b0dd-3d0e88565c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:09.745225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b0292-0172-46a5-b0dd-3d0e88565c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:09.746830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b0292-0172-46a5-b0dd-3d0e88565c44 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:09.756487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1128/2242] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:53:09 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:53:09.760787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d926fb-1967-4ec7-b58e-c13bc1d8a630 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:09.771332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d926fb-1967-4ec7-b58e-c13bc1d8a630 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:09.776221 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4091be4-a1a2-4b69-8e76-33c22c184fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:09.777095 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4091be4-a1a2-4b69-8e76-33c22c184fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:09.777381 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4091be4-a1a2-4b69-8e76-33c22c184fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:09.777662 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4091be4-a1a2-4b69-8e76-33c22c184fa3 admin admin] PATH_INFO: `/v3/projects/280da8b789a04062997d0c9bd25e86e2/users/7f2e905603904018aa70fc922c0a16ed/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:09.779745 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4091be4-a1a2-4b69-8e76-33c22c184fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280da8b789a04062997d0c9bd25e86e2, user_id=7f2e905603904018aa70fc922c0a16ed, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:09.782535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4091be4-a1a2-4b69-8e76-33c22c184fa3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:09.794022 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1115/2243] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:53:09 2022] PUT /identity/v3/projects/280da8b789a04062997d0c9bd25e86e2/users/7f2e905603904018aa70fc922c0a16ed/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:53:16.328403 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c2cd7-729d-4b49-8057-2f2f113879e7 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:16.329427 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c2cd7-729d-4b49-8057-2f2f113879e7 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:16.329877 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c2cd7-729d-4b49-8057-2f2f113879e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:16.366982 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-df3c2cd7-729d-4b49-8057-2f2f113879e7 None None] MFA Rules not processed for user `7f2e905603904018aa70fc922c0a16ed`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:16.368384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-df3c2cd7-729d-4b49-8057-2f2f113879e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:16.450387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1129/2244] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:16.467701 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4091be4-a1a2-4b69-8e76-33c22c184fa3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:16.469656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a4091be4-a1a2-4b69-8e76-33c22c184fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:16.540130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4091be4-a1a2-4b69-8e76-33c22c184fa3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:16.544786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29c54c-be2a-4114-814c-d97644e5bff1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2691f7bb4ed84de4bb5901710a96d766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:16.545874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29c54c-be2a-4114-814c-d97644e5bff1 service glance] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:16.546331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29c54c-be2a-4114-814c-d97644e5bff1 service glance] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:16.546726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29c54c-be2a-4114-814c-d97644e5bff1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:16.609875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29c54c-be2a-4114-814c-d97644e5bff1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:16.611385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29c54c-be2a-4114-814c-d97644e5bff1 service glance] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:16.620891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1116/2245] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:53:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:53:16.752167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5009e-fae6-4b15-8996-d9b7561c7760 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:16.752457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5009e-fae6-4b15-8996-d9b7561c7760 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:16.752740 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5009e-fae6-4b15-8996-d9b7561c7760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:16.783823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-09f5009e-fae6-4b15-8996-d9b7561c7760 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:16.784961 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-09f5009e-fae6-4b15-8996-d9b7561c7760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:16.848085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1130/2246] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:53:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:16.860973 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29c54c-be2a-4114-814c-d97644e5bff1 service glance] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:16.862362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-bb29c54c-be2a-4114-814c-d97644e5bff1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:16.931901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29c54c-be2a-4114-814c-d97644e5bff1 service glance] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:16.937308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db7afb-f61c-4a20-90e7-346b6b3b20b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:16.937995 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db7afb-f61c-4a20-90e7-346b6b3b20b8 service swift] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:16.938280 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db7afb-f61c-4a20-90e7-346b6b3b20b8 service swift] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:16.938559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db7afb-f61c-4a20-90e7-346b6b3b20b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:16.947113 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db7afb-f61c-4a20-90e7-346b6b3b20b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:16.948699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db7afb-f61c-4a20-90e7-346b6b3b20b8 service swift] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:16.956626 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1117/2247] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:53:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:53:20.608877 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec5fac-7c8e-4b71-ade7-307876550fab None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:20.609419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec5fac-7c8e-4b71-ade7-307876550fab None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:20.609649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec5fac-7c8e-4b71-ade7-307876550fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:20.680182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-9bec5fac-7c8e-4b71-ade7-307876550fab None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:20.681664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9bec5fac-7c8e-4b71-ade7-307876550fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:20.701171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1131/2248] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:53:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:20.732358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db7afb-f61c-4a20-90e7-346b6b3b20b8 service swift] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:20.766033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db7afb-f61c-4a20-90e7-346b6b3b20b8 service swift] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:20.815089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38911586-0c84-4110-af90-cb3551d949d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:20.817344 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38911586-0c84-4110-af90-cb3551d949d5 service swift] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:20.817850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38911586-0c84-4110-af90-cb3551d949d5 service swift] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:20.818330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38911586-0c84-4110-af90-cb3551d949d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:20.868548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38911586-0c84-4110-af90-cb3551d949d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:20.877117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38911586-0c84-4110-af90-cb3551d949d5 service swift] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:20.930416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1118/2249] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:53:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:53:30.545756 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638239fd-5930-49fd-8c05-978b9db4c689 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:30.546365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638239fd-5930-49fd-8c05-978b9db4c689 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:30.546365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638239fd-5930-49fd-8c05-978b9db4c689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:30.565591 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-638239fd-5930-49fd-8c05-978b9db4c689 None None] MFA Rules not processed for user `d07e0cd23d0c4f2ab7aba38a564dc693`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:30.566969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-638239fd-5930-49fd-8c05-978b9db4c689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:30.575809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1132/2250] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:33.078390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38911586-0c84-4110-af90-cb3551d949d5 service swift] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:33.079812 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-38911586-0c84-4110-af90-cb3551d949d5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:33.169862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38911586-0c84-4110-af90-cb3551d949d5 service swift] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:33.174942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be6071-a1a7-4ec9-879c-ebb850987a3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15975bd016ed48f9bf5c88845180ebf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:33.175579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6071-a1a7-4ec9-879c-ebb850987a3d service placement] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:33.175861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6071-a1a7-4ec9-879c-ebb850987a3d service placement] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:33.176136 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6071-a1a7-4ec9-879c-ebb850987a3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:33.178447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-55be6071-a1a7-4ec9-879c-ebb850987a3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:33.189680 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be6071-a1a7-4ec9-879c-ebb850987a3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:33.191292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be6071-a1a7-4ec9-879c-ebb850987a3d service placement] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:33.201656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1119/2251] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:53:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:53:34.538244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7122ef-32e8-49fc-b586-dc8d2a194ab0 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:34.539078 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7122ef-32e8-49fc-b586-dc8d2a194ab0 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:34.539526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7122ef-32e8-49fc-b586-dc8d2a194ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:34.578001 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5a7122ef-32e8-49fc-b586-dc8d2a194ab0 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:34.579485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5a7122ef-32e8-49fc-b586-dc8d2a194ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:34.588705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1133/2252] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:53:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:34.607404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be6071-a1a7-4ec9-879c-ebb850987a3d service placement] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:34.636966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be6071-a1a7-4ec9-879c-ebb850987a3d service placement] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:34.642930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b280a-f653-443f-99fd-27893d4696a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:34.644077 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b280a-f653-443f-99fd-27893d4696a5 service swift] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:34.644700 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b280a-f653-443f-99fd-27893d4696a5 service swift] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:34.645144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b280a-f653-443f-99fd-27893d4696a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:34.658287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b280a-f653-443f-99fd-27893d4696a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:34.661384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b280a-f653-443f-99fd-27893d4696a5 service swift] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:34.677524 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1120/2253] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:53:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:53:48.037933 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7122ef-32e8-49fc-b586-dc8d2a194ab0 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:48.039591 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5a7122ef-32e8-49fc-b586-dc8d2a194ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:48.122605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7122ef-32e8-49fc-b586-dc8d2a194ab0 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:48.127639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5753e0-aec9-4fd4-9c72-3524185b54a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:48.128792 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5753e0-aec9-4fd4-9c72-3524185b54a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:48.129072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5753e0-aec9-4fd4-9c72-3524185b54a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:48.129342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5753e0-aec9-4fd4-9c72-3524185b54a0 admin admin] PATH_INFO: `/v3/users/feb8ddf0abd84c1caed8501c57b56f20` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:48.130573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5753e0-aec9-4fd4-9c72-3524185b54a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb8ddf0abd84c1caed8501c57b56f20)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:48.133029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5753e0-aec9-4fd4-9c72-3524185b54a0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:48.188012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4a5753e0-aec9-4fd4-9c72-3524185b54a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb8ddf0abd84c1caed8501c57b56f20'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:48.200611 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4a5753e0-aec9-4fd4-9c72-3524185b54a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb8ddf0abd84c1caed8501c57b56f20'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:48.201399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4a5753e0-aec9-4fd4-9c72-3524185b54a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb8ddf0abd84c1caed8501c57b56f20'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:48.202374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4a5753e0-aec9-4fd4-9c72-3524185b54a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb8ddf0abd84c1caed8501c57b56f20'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:48.211105 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4a5753e0-aec9-4fd4-9c72-3524185b54a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb8ddf0abd84c1caed8501c57b56f20'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:48.225768 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1134/2254] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:53:48 2022] DELETE /identity/v3/users/feb8ddf0abd84c1caed8501c57b56f20 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:53:48.624018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b280a-f653-443f-99fd-27893d4696a5 service swift] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:48.639930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b280a-f653-443f-99fd-27893d4696a5 service swift] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:48.712194 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:48.713424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:48.713729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:48.713990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] PATH_INFO: `/v3/projects/23f1bf5dafe744d48d952fbe6209dd79` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:48.715269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f1bf5dafe744d48d952fbe6209dd79)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:48.717348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:48.777602 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f1bf5dafe744d48d952fbe6209dd79', 'request_id': 'req-174e36e6-afa9-45d1-a84d-96d6dc62adf1'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:48.794966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f1bf5dafe744d48d952fbe6209dd79', 'request_id': 'req-174e36e6-afa9-45d1-a84d-96d6dc62adf1'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:48.794966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f1bf5dafe744d48d952fbe6209dd79', 'request_id': 'req-174e36e6-afa9-45d1-a84d-96d6dc62adf1'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:48.803954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] The token cache is being invalidate because project 23f1bf5dafe744d48d952fbe6209dd79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:53:48.804662 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:48.805930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-174e36e6-afa9-45d1-a84d-96d6dc62adf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:48.807690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1121/2255] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:53:48 2022] DELETE /identity/v3/projects/23f1bf5dafe744d48d952fbe6209dd79 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:53:48.813799 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341cfda-9b9e-40a5-8826-b05d48a765e5 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:48.814153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341cfda-9b9e-40a5-8826-b05d48a765e5 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:48.814520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341cfda-9b9e-40a5-8826-b05d48a765e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:48.836347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f341cfda-9b9e-40a5-8826-b05d48a765e5 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:48.838953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f341cfda-9b9e-40a5-8826-b05d48a765e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:48.906124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1135/2256] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:48.915365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750baf06-cb34-4bf0-8b59-71c29836fec4 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:48.915655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750baf06-cb34-4bf0-8b59-71c29836fec4 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:48.915946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750baf06-cb34-4bf0-8b59-71c29836fec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:48.936119 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-750baf06-cb34-4bf0-8b59-71c29836fec4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:48.937276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-750baf06-cb34-4bf0-8b59-71c29836fec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:48.947591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1122/2257] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:48.952094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341cfda-9b9e-40a5-8826-b05d48a765e5 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:48.964385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341cfda-9b9e-40a5-8826-b05d48a765e5 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:48.969885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c4f20-abbb-4ff2-9e0d-8a14d0049889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:48.970557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c4f20-abbb-4ff2-9e0d-8a14d0049889 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:48.971075 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c4f20-abbb-4ff2-9e0d-8a14d0049889 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:48.971354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c4f20-abbb-4ff2-9e0d-8a14d0049889 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:48.972282 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c4f20-abbb-4ff2-9e0d-8a14d0049889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:53:48.972676 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c4f20-abbb-4ff2-9e0d-8a14d0049889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:48.974827 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c4f20-abbb-4ff2-9e0d-8a14d0049889 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:48.998124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1136/2258] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:53:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:53:48.999801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750baf06-cb34-4bf0-8b59-71c29836fec4 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:49.011039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750baf06-cb34-4bf0-8b59-71c29836fec4 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:49.016642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c33fa-7bd1-4d1d-b95e-4e82b25f93bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:49.017295 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c33fa-7bd1-4d1d-b95e-4e82b25f93bc admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.017575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c33fa-7bd1-4d1d-b95e-4e82b25f93bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.017845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c33fa-7bd1-4d1d-b95e-4e82b25f93bc admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.018553 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c33fa-7bd1-4d1d-b95e-4e82b25f93bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:49.021145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c33fa-7bd1-4d1d-b95e-4e82b25f93bc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:49.049143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1123/2259] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:53:48 2022] POST /identity/v3/projects => generated 376 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:53:49.053618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c4f20-abbb-4ff2-9e0d-8a14d0049889 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:49.063914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c4f20-abbb-4ff2-9e0d-8a14d0049889 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:49.187085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49803922-7e63-4e82-9f89-2d1b791e4267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:49.187763 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49803922-7e63-4e82-9f89-2d1b791e4267 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.188281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49803922-7e63-4e82-9f89-2d1b791e4267 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.188569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49803922-7e63-4e82-9f89-2d1b791e4267 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.189306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49803922-7e63-4e82-9f89-2d1b791e4267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:49.194035 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49803922-7e63-4e82-9f89-2d1b791e4267 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:49.230861 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1137/2260] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:53:49 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:53:49.234785 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c33fa-7bd1-4d1d-b95e-4e82b25f93bc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:49.247740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c33fa-7bd1-4d1d-b95e-4e82b25f93bc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:49.261071 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ed446-5643-466b-a939-ad0014d91d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:49.262256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ed446-5643-466b-a939-ad0014d91d34 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.262709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ed446-5643-466b-a939-ad0014d91d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.263110 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ed446-5643-466b-a939-ad0014d91d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.264254 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ed446-5643-466b-a939-ad0014d91d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:49.266550 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ed446-5643-466b-a939-ad0014d91d34 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:49.282271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1124/2261] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:53:49 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:53:49.286993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49803922-7e63-4e82-9f89-2d1b791e4267 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:49.299934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49803922-7e63-4e82-9f89-2d1b791e4267 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:49.308897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acd884-5604-497a-8521-9fb0afe677c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:49.309609 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acd884-5604-497a-8521-9fb0afe677c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.309895 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acd884-5604-497a-8521-9fb0afe677c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.310174 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acd884-5604-497a-8521-9fb0afe677c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.310948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acd884-5604-497a-8521-9fb0afe677c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:49.313056 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acd884-5604-497a-8521-9fb0afe677c9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:49.324018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1138/2262] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:53:49 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:53:49.328075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ed446-5643-466b-a939-ad0014d91d34 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:49.340999 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ed446-5643-466b-a939-ad0014d91d34 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:49.351552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c602cd-ed45-4621-9bb5-2a20521934d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:49.352449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c602cd-ed45-4621-9bb5-2a20521934d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.352729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c602cd-ed45-4621-9bb5-2a20521934d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.353005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c602cd-ed45-4621-9bb5-2a20521934d7 admin admin] PATH_INFO: `/v3/projects/e6bb2708ae784b71868bcc470c0942c6/users/5322ce65fc9f4b79b1d87c98fc85eb5c/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.367800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c602cd-ed45-4621-9bb5-2a20521934d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bb2708ae784b71868bcc470c0942c6, user_id=5322ce65fc9f4b79b1d87c98fc85eb5c, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:49.370459 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c602cd-ed45-4621-9bb5-2a20521934d7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:49.383546 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1125/2263] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:53:49 2022] PUT /identity/v3/projects/e6bb2708ae784b71868bcc470c0942c6/users/5322ce65fc9f4b79b1d87c98fc85eb5c/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:53:49.393615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b620-a1ca-4fe0-b2fe-56f1c5e69dc3 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.394020 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b620-a1ca-4fe0-b2fe-56f1c5e69dc3 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.394914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b620-a1ca-4fe0-b2fe-56f1c5e69dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.435778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-3e85b620-a1ca-4fe0-b2fe-56f1c5e69dc3 None None] MFA Rules not processed for user `5322ce65fc9f4b79b1d87c98fc85eb5c`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:49.437497 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3e85b620-a1ca-4fe0-b2fe-56f1c5e69dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:49.500914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6341-a09e-41c1-8418-f9f3729c2624 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.501190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6341-a09e-41c1-8418-f9f3729c2624 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.501465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6341-a09e-41c1-8418-f9f3729c2624 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.503279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1126/2264] 10.222.0.117 () {54 vars in 926 bytes} [Mon Jan 24 16:53:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 24 16:53:49.509905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162a2b4-ea6b-43b9-9346-c29324c020c2 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.510190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162a2b4-ea6b-43b9-9346-c29324c020c2 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.512079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162a2b4-ea6b-43b9-9346-c29324c020c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.524275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1139/2265] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:49.536155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b620-a1ca-4fe0-b2fe-56f1c5e69dc3 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:49.537573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3e85b620-a1ca-4fe0-b2fe-56f1c5e69dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:49.562429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-8162a2b4-ea6b-43b9-9346-c29324c020c2 None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:49.563751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8162a2b4-ea6b-43b9-9346-c29324c020c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:49.642640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b620-a1ca-4fe0-b2fe-56f1c5e69dc3 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:49.649198 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b66862-5b5f-4471-8f3a-57fd103e8f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:49.649835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66862-5b5f-4471-8f3a-57fd103e8f85 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.650118 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66862-5b5f-4471-8f3a-57fd103e8f85 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.650393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66862-5b5f-4471-8f3a-57fd103e8f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.651746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1127/2266] 10.222.0.117 () {58 vars in 1023 bytes} [Mon Jan 24 16:53:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:53:49.658648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b66862-5b5f-4471-8f3a-57fd103e8f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:49.660601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b66862-5b5f-4471-8f3a-57fd103e8f85 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:49.662940 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162a2b4-ea6b-43b9-9346-c29324c020c2 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:49.664279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8162a2b4-ea6b-43b9-9346-c29324c020c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:49.669578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1140/2267] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:53:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:53:49.747526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162a2b4-ea6b-43b9-9346-c29324c020c2 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:49.751303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145ff4-473a-427d-b313-bc360525f378 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2691f7bb4ed84de4bb5901710a96d766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:49.751944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145ff4-473a-427d-b313-bc360525f378 service glance] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.752249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145ff4-473a-427d-b313-bc360525f378 service glance] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.752490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145ff4-473a-427d-b313-bc360525f378 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.764925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48145ff4-473a-427d-b313-bc360525f378 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:49.766402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48145ff4-473a-427d-b313-bc360525f378 service glance] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:49.777765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1128/2268] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:53:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:53:49.853429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71551d5-d1db-4c4d-ba76-7f1d3ba20c62 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.853724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71551d5-d1db-4c4d-ba76-7f1d3ba20c62 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.854005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71551d5-d1db-4c4d-ba76-7f1d3ba20c62 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.855960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1141/2269] 10.222.0.117 () {54 vars in 926 bytes} [Mon Jan 24 16:53:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:53:49.861246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145ff4-473a-427d-b313-bc360525f378 service glance] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:49.863449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aae4fd-c71a-4d24-bd4a-d048320f09fc None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.863880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aae4fd-c71a-4d24-bd4a-d048320f09fc None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.864174 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aae4fd-c71a-4d24-bd4a-d048320f09fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.886041 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-69aae4fd-c71a-4d24-bd4a-d048320f09fc None None] MFA Rules not processed for user `aa9834b75e2b4ac787f3917564090d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:49.887830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-69aae4fd-c71a-4d24-bd4a-d048320f09fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:49.930118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145ff4-473a-427d-b313-bc360525f378 service glance] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:49.935163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:49.936157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.936440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.936710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] PATH_INFO: `/v3/users/5322ce65fc9f4b79b1d87c98fc85eb5c` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.938032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5322ce65fc9f4b79b1d87c98fc85eb5c)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:49.940454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:49.942057 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1142/2270] 10.222.0.117 () {58 vars in 1023 bytes} [Mon Jan 24 16:53:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:49.957234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aae4fd-c71a-4d24-bd4a-d048320f09fc None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:49.959568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-69aae4fd-c71a-4d24-bd4a-d048320f09fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:49.971533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aae4fd-c71a-4d24-bd4a-d048320f09fc None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:49.977556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898f4b-a3a4-45ac-8584-7e7661969271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:49.979292 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898f4b-a3a4-45ac-8584-7e7661969271 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:49.979599 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898f4b-a3a4-45ac-8584-7e7661969271 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:49.979883 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898f4b-a3a4-45ac-8584-7e7661969271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:49.993146 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5322ce65fc9f4b79b1d87c98fc85eb5c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:49.994629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5898f4b-a3a4-45ac-8584-7e7661969271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:49.996124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5898f4b-a3a4-45ac-8584-7e7661969271 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:50.002506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5322ce65fc9f4b79b1d87c98fc85eb5c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:50.006340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1143/2271] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:53:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:53:50.020016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5322ce65fc9f4b79b1d87c98fc85eb5c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:50.032391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5322ce65fc9f4b79b1d87c98fc85eb5c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:50.033152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5322ce65fc9f4b79b1d87c98fc85eb5c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:50.040145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1129/2272] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:53:49 2022] DELETE /identity/v3/users/5322ce65fc9f4b79b1d87c98fc85eb5c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:53:50.044637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd97d-f063-48ad-9e3a-14a5e576ea66 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:50.045169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd97d-f063-48ad-9e3a-14a5e576ea66 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:50.045667 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd97d-f063-48ad-9e3a-14a5e576ea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:50.065556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-3cffd97d-f063-48ad-9e3a-14a5e576ea66 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:50.067073 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3cffd97d-f063-48ad-9e3a-14a5e576ea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:50.166026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1144/2273] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:50.178624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:50.180743 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:50.263486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280bedb-2a31-473b-9b50-f3af25e1bb1e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:50.267527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd0e46-2d42-4327-a056-b8fe08bf780e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:50.268251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd0e46-2d42-4327-a056-b8fe08bf780e service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:50.268606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd0e46-2d42-4327-a056-b8fe08bf780e service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:50.269093 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd0e46-2d42-4327-a056-b8fe08bf780e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:50.281571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd0e46-2d42-4327-a056-b8fe08bf780e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:50.282642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd0e46-2d42-4327-a056-b8fe08bf780e service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:50.293182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1130/2274] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:53:50.961693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd97d-f063-48ad-9e3a-14a5e576ea66 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:50.963201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3cffd97d-f063-48ad-9e3a-14a5e576ea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:50.976669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd97d-f063-48ad-9e3a-14a5e576ea66 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:50.981862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:50.982704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:50.983142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:50.983426 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] PATH_INFO: `/v3/projects/e6bb2708ae784b71868bcc470c0942c6` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:50.985089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bb2708ae784b71868bcc470c0942c6)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:50.987124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:51.048330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bb2708ae784b71868bcc470c0942c6', 'request_id': 'req-9ba5ea57-8e7d-47af-95a8-551ef4693980'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:51.055733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bb2708ae784b71868bcc470c0942c6', 'request_id': 'req-9ba5ea57-8e7d-47af-95a8-551ef4693980'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:51.070339 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bb2708ae784b71868bcc470c0942c6', 'request_id': 'req-9ba5ea57-8e7d-47af-95a8-551ef4693980'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:51.097082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] The token cache is being invalidate because project e6bb2708ae784b71868bcc470c0942c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:53:51.097910 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:51.100140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9ba5ea57-8e7d-47af-95a8-551ef4693980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:53:51.102256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1145/2275] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:53:50 2022] DELETE /identity/v3/projects/e6bb2708ae784b71868bcc470c0942c6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:53:51.108475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77cd4-b923-4099-8d73-192de3073c3b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.109376 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77cd4-b923-4099-8d73-192de3073c3b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.109813 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77cd4-b923-4099-8d73-192de3073c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.131223 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d6e77cd4-b923-4099-8d73-192de3073c3b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:51.140844 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d6e77cd4-b923-4099-8d73-192de3073c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:51.250882 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1131/2276] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:53:51.251429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df57b-60c0-4ecf-8608-fa0b27c2f66a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.251801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df57b-60c0-4ecf-8608-fa0b27c2f66a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.252072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df57b-60c0-4ecf-8608-fa0b27c2f66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.281363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f59df57b-60c0-4ecf-8608-fa0b27c2f66a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:51.287981 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f59df57b-60c0-4ecf-8608-fa0b27c2f66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:51.300026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1146/2277] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:53:51.305461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e77cd4-b923-4099-8d73-192de3073c3b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:51.317589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e77cd4-b923-4099-8d73-192de3073c3b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:51.323467 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fa9e1-d75a-4cff-9263-d99e935ac1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:51.324189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fa9e1-d75a-4cff-9263-d99e935ac1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.324548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fa9e1-d75a-4cff-9263-d99e935ac1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.324732 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fa9e1-d75a-4cff-9263-d99e935ac1f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.325529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fa9e1-d75a-4cff-9263-d99e935ac1f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:53:51.325821 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fa9e1-d75a-4cff-9263-d99e935ac1f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:51.327583 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fa9e1-d75a-4cff-9263-d99e935ac1f7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:51.340954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1132/2278] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:53:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:53:51.346596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df57b-60c0-4ecf-8608-fa0b27c2f66a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:51.357915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df57b-60c0-4ecf-8608-fa0b27c2f66a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:51.364708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e6d2d-21de-49cb-b836-f2ac22bac6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:51.365666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e6d2d-21de-49cb-b836-f2ac22bac6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.366118 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e6d2d-21de-49cb-b836-f2ac22bac6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.366621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e6d2d-21de-49cb-b836-f2ac22bac6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.367525 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e6d2d-21de-49cb-b836-f2ac22bac6e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:51.370309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e6d2d-21de-49cb-b836-f2ac22bac6e8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:51.402123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1147/2279] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:53:51 2022] POST /identity/v3/projects => generated 366 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:53:51.406458 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fa9e1-d75a-4cff-9263-d99e935ac1f7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:51.418603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fa9e1-d75a-4cff-9263-d99e935ac1f7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:51.481566 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75aece5-b265-4485-ac19-1cb0f41660c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:51.482315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aece5-b265-4485-ac19-1cb0f41660c4 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.482457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aece5-b265-4485-ac19-1cb0f41660c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.482730 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aece5-b265-4485-ac19-1cb0f41660c4 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.483461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75aece5-b265-4485-ac19-1cb0f41660c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:51.485388 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75aece5-b265-4485-ac19-1cb0f41660c4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:51.505669 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1133/2280] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:53:51 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:53:51.509720 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e6d2d-21de-49cb-b836-f2ac22bac6e8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:51.520112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e6d2d-21de-49cb-b836-f2ac22bac6e8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:51.524822 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68455c-3eec-4684-beb7-8a7375f9de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:51.525469 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68455c-3eec-4684-beb7-8a7375f9de93 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.525752 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68455c-3eec-4684-beb7-8a7375f9de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.526030 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68455c-3eec-4684-beb7-8a7375f9de93 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.526792 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68455c-3eec-4684-beb7-8a7375f9de93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:51.528375 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68455c-3eec-4684-beb7-8a7375f9de93 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:51.538541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1148/2281] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:53:51 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:53:51.542287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75aece5-b265-4485-ac19-1cb0f41660c4 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:51.552448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75aece5-b265-4485-ac19-1cb0f41660c4 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:51.557104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c10c2-08a7-4f81-a1bc-68bd7db12188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:51.557747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c10c2-08a7-4f81-a1bc-68bd7db12188 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.558282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c10c2-08a7-4f81-a1bc-68bd7db12188 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.558558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c10c2-08a7-4f81-a1bc-68bd7db12188 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.559350 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c10c2-08a7-4f81-a1bc-68bd7db12188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:51.560926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c10c2-08a7-4f81-a1bc-68bd7db12188 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:51.571281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1134/2282] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:53:51 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:53:51.575293 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68455c-3eec-4684-beb7-8a7375f9de93 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:51.585084 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68455c-3eec-4684-beb7-8a7375f9de93 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:51.589654 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88cd6a-61fb-4aea-ab03-3c0b68ef9822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:51.590509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88cd6a-61fb-4aea-ab03-3c0b68ef9822 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.590818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88cd6a-61fb-4aea-ab03-3c0b68ef9822 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.591100 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88cd6a-61fb-4aea-ab03-3c0b68ef9822 admin admin] PATH_INFO: `/v3/projects/0c489229b8a34b899bb3852aefa0b740/users/3c15bb53543048479c5d7d527b0e2775/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.606519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88cd6a-61fb-4aea-ab03-3c0b68ef9822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c489229b8a34b899bb3852aefa0b740, user_id=3c15bb53543048479c5d7d527b0e2775, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:51.609238 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88cd6a-61fb-4aea-ab03-3c0b68ef9822 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:51.624592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1149/2283] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:53:51 2022] PUT /identity/v3/projects/0c489229b8a34b899bb3852aefa0b740/users/3c15bb53543048479c5d7d527b0e2775/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:53:51.635508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd30c-ebc6-42e0-9ad0-19653e99e909 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.635799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd30c-ebc6-42e0-9ad0-19653e99e909 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.636076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd30c-ebc6-42e0-9ad0-19653e99e909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.663478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-dc0fd30c-ebc6-42e0-9ad0-19653e99e909 None None] MFA Rules not processed for user `3c15bb53543048479c5d7d527b0e2775`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:51.664691 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dc0fd30c-ebc6-42e0-9ad0-19653e99e909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:51.731650 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1135/2284] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:51.736088 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88cd6a-61fb-4aea-ab03-3c0b68ef9822 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:51.796947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88cd6a-61fb-4aea-ab03-3c0b68ef9822 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:51.802239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffc69d-132e-4622-a73d-882295964b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:51.802996 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffc69d-132e-4622-a73d-882295964b8f admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.803288 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffc69d-132e-4622-a73d-882295964b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.803564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffc69d-132e-4622-a73d-882295964b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.804390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffc69d-132e-4622-a73d-882295964b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:51.806283 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffc69d-132e-4622-a73d-882295964b8f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:51.832814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1150/2285] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:53:51 2022] POST /identity/v3/projects => generated 364 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:53:51.836473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fd30c-ebc6-42e0-9ad0-19653e99e909 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:51.846924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fd30c-ebc6-42e0-9ad0-19653e99e909 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:51.906058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9be01-62c2-445d-88cc-fc604b1bef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:51.906792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9be01-62c2-445d-88cc-fc604b1bef0c admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.907177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9be01-62c2-445d-88cc-fc604b1bef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.907571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9be01-62c2-445d-88cc-fc604b1bef0c admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.908386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9be01-62c2-445d-88cc-fc604b1bef0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:51.910998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9be01-62c2-445d-88cc-fc604b1bef0c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:51.931953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1136/2286] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:53:51 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:53:51.936176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffc69d-132e-4622-a73d-882295964b8f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:51.947473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffc69d-132e-4622-a73d-882295964b8f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:51.952416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ecaa6-2fe5-4af7-ac64-37b1aa9091b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:51.953077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ecaa6-2fe5-4af7-ac64-37b1aa9091b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.953359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ecaa6-2fe5-4af7-ac64-37b1aa9091b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.953636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ecaa6-2fe5-4af7-ac64-37b1aa9091b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:51.954385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ecaa6-2fe5-4af7-ac64-37b1aa9091b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:51.956153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ecaa6-2fe5-4af7-ac64-37b1aa9091b3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:51.969625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1151/2287] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:53:51 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:53:51.971099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9be01-62c2-445d-88cc-fc604b1bef0c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:51.982583 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9be01-62c2-445d-88cc-fc604b1bef0c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:51.988590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96175a00-8bff-4a31-8baa-cace5ae56490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:51.989655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96175a00-8bff-4a31-8baa-cace5ae56490 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:51.990009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96175a00-8bff-4a31-8baa-cace5ae56490 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:51.990357 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96175a00-8bff-4a31-8baa-cace5ae56490 admin admin] PATH_INFO: `/v3/projects/d0c2c20ba6a64cb8970afafc3d6e28b1/users/b892e2b7a93b4c00909b3ca285507261/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:52.009101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96175a00-8bff-4a31-8baa-cace5ae56490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c2c20ba6a64cb8970afafc3d6e28b1, user_id=b892e2b7a93b4c00909b3ca285507261, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:52.012073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96175a00-8bff-4a31-8baa-cace5ae56490 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:52.025807 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1137/2288] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:53:51 2022] PUT /identity/v3/projects/d0c2c20ba6a64cb8970afafc3d6e28b1/users/b892e2b7a93b4c00909b3ca285507261/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:53:52.029693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ecaa6-2fe5-4af7-ac64-37b1aa9091b3 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:52.040516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ecaa6-2fe5-4af7-ac64-37b1aa9091b3 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:52.111202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3bc40-aad3-42bf-958d-c8368e3d23b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:52.111869 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3bc40-aad3-42bf-958d-c8368e3d23b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:52.112154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3bc40-aad3-42bf-958d-c8368e3d23b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:52.112435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3bc40-aad3-42bf-958d-c8368e3d23b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:52.113778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3bc40-aad3-42bf-958d-c8368e3d23b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:52.115443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3bc40-aad3-42bf-958d-c8368e3d23b4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:52.126405 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1152/2289] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:53:52 2022] GET /identity/v3/roles => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:53:52.130966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96175a00-8bff-4a31-8baa-cace5ae56490 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:52.142587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96175a00-8bff-4a31-8baa-cace5ae56490 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:52.148030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389b91a-aefc-4f11-9315-db361a9caa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:52.149122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b91a-aefc-4f11-9315-db361a9caa87 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:52.149471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b91a-aefc-4f11-9315-db361a9caa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:52.149985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b91a-aefc-4f11-9315-db361a9caa87 admin admin] PATH_INFO: `/v3/projects/d0c2c20ba6a64cb8970afafc3d6e28b1/users/b892e2b7a93b4c00909b3ca285507261/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:52.158955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389b91a-aefc-4f11-9315-db361a9caa87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c2c20ba6a64cb8970afafc3d6e28b1, user_id=b892e2b7a93b4c00909b3ca285507261, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:52.162549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389b91a-aefc-4f11-9315-db361a9caa87 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:52.175673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1138/2290] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:53:52 2022] PUT /identity/v3/projects/d0c2c20ba6a64cb8970afafc3d6e28b1/users/b892e2b7a93b4c00909b3ca285507261/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:53:52.187470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49398918-8ce2-4fda-95d3-57935c91d790 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:52.187860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49398918-8ce2-4fda-95d3-57935c91d790 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:52.188203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49398918-8ce2-4fda-95d3-57935c91d790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:52.218394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-49398918-8ce2-4fda-95d3-57935c91d790 None None] MFA Rules not processed for user `b892e2b7a93b4c00909b3ca285507261`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:52.219838 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-49398918-8ce2-4fda-95d3-57935c91d790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:52.292487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1153/2291] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:53:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:52.302874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389b91a-aefc-4f11-9315-db361a9caa87 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:52.304639 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c389b91a-aefc-4f11-9315-db361a9caa87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:52.391474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389b91a-aefc-4f11-9315-db361a9caa87 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:52.395831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b045d-f056-4ed8-8e83-bf448481bac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:52.396464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b045d-f056-4ed8-8e83-bf448481bac2 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:52.396740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b045d-f056-4ed8-8e83-bf448481bac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:52.397012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b045d-f056-4ed8-8e83-bf448481bac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:52.405906 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b045d-f056-4ed8-8e83-bf448481bac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:52.407411 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b045d-f056-4ed8-8e83-bf448481bac2 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:52.417467 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1139/2292] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:53:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:53:52.502287 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49398918-8ce2-4fda-95d3-57935c91d790 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:52.520705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49398918-8ce2-4fda-95d3-57935c91d790 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:52.530629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63bc8f-1596-4594-ae89-7315900e98ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:52.531471 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63bc8f-1596-4594-ae89-7315900e98ea service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:52.531865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63bc8f-1596-4594-ae89-7315900e98ea service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:52.532093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63bc8f-1596-4594-ae89-7315900e98ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:52.612577 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63bc8f-1596-4594-ae89-7315900e98ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:52.615531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63bc8f-1596-4594-ae89-7315900e98ea service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:52.627837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1154/2293] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:53:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:53:52.880891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e384e0-7428-4941-b70c-9c003994d7b1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:52.881182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e384e0-7428-4941-b70c-9c003994d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:52.881457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e384e0-7428-4941-b70c-9c003994d7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:52.943461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-f5e384e0-7428-4941-b70c-9c003994d7b1 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:53:52.944857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f5e384e0-7428-4941-b70c-9c003994d7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:53.020776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1140/2294] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:53:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:53:53.032650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63bc8f-1596-4594-ae89-7315900e98ea service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:53:53.034026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6c63bc8f-1596-4594-ae89-7315900e98ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:53:53.120536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63bc8f-1596-4594-ae89-7315900e98ea service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:53:53.125669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152322d-153b-40ea-bbaa-dd0e9c3755ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:53:53.126306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152322d-153b-40ea-bbaa-dd0e9c3755ef service swift] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:53:53.126592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152322d-153b-40ea-bbaa-dd0e9c3755ef service swift] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:53:53.126882 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152322d-153b-40ea-bbaa-dd0e9c3755ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:53:53.136621 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152322d-153b-40ea-bbaa-dd0e9c3755ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:53:53.138207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152322d-153b-40ea-bbaa-dd0e9c3755ef service swift] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:53:53.146549 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1155/2295] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:53:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:54:05.578898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e1c96-a105-4bc8-8a52-df889e00a3ce None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:05.579517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e1c96-a105-4bc8-8a52-df889e00a3ce None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:05.579517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e1c96-a105-4bc8-8a52-df889e00a3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:05.597794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-3f0e1c96-a105-4bc8-8a52-df889e00a3ce None None] MFA Rules not processed for user `43bca89ee28143d780d350c37b3af65c`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:05.599008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3f0e1c96-a105-4bc8-8a52-df889e00a3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:05.658866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1141/2296] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:54:07.372143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152322d-153b-40ea-bbaa-dd0e9c3755ef service swift] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:07.450185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152322d-153b-40ea-bbaa-dd0e9c3755ef service swift] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:07.456060 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:07.457321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:07.457991 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:07.458430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] PATH_INFO: `/v3/users/3c15bb53543048479c5d7d527b0e2775` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:07.460072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c15bb53543048479c5d7d527b0e2775)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:07.462272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:07.514945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c15bb53543048479c5d7d527b0e2775'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:07.527432 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c15bb53543048479c5d7d527b0e2775'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:07.528136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c15bb53543048479c5d7d527b0e2775'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:07.528744 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c15bb53543048479c5d7d527b0e2775'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:07.537840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c15bb53543048479c5d7d527b0e2775'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:07.551500 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1156/2297] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:54:07 2022] DELETE /identity/v3/users/3c15bb53543048479c5d7d527b0e2775 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:07.556010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4461bc-5688-434f-b220-4a4c7a28325a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:07.556494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4461bc-5688-434f-b220-4a4c7a28325a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:07.556590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4461bc-5688-434f-b220-4a4c7a28325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:07.575373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ff4461bc-5688-434f-b220-4a4c7a28325a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:07.576619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ff4461bc-5688-434f-b220-4a4c7a28325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:07.651655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1142/2298] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:07.661784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:07.663587 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:07.738729 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcb12c-c5e8-4a17-afd1-b8d7f7e08609 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:07.742742 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c5cd0-e4d7-4eae-b1ed-61b49558dca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:07.743505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5cd0-e4d7-4eae-b1ed-61b49558dca2 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:07.743805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5cd0-e4d7-4eae-b1ed-61b49558dca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:07.744183 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5cd0-e4d7-4eae-b1ed-61b49558dca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:07.754383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c5cd0-e4d7-4eae-b1ed-61b49558dca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:07.756347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c5cd0-e4d7-4eae-b1ed-61b49558dca2 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:07.770251 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1157/2299] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:08.623131 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4461bc-5688-434f-b220-4a4c7a28325a None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:08.624613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ff4461bc-5688-434f-b220-4a4c7a28325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:08.638704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4461bc-5688-434f-b220-4a4c7a28325a None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:08.645980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:08.647142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:08.647248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:08.647496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] PATH_INFO: `/v3/projects/0c489229b8a34b899bb3852aefa0b740` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:08.650448 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c489229b8a34b899bb3852aefa0b740)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:08.654173 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:08.715996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c489229b8a34b899bb3852aefa0b740', 'request_id': 'req-083b6bca-941c-4ac1-a4f5-d3653e62b23f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:08.725605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c489229b8a34b899bb3852aefa0b740', 'request_id': 'req-083b6bca-941c-4ac1-a4f5-d3653e62b23f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:08.735384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c489229b8a34b899bb3852aefa0b740', 'request_id': 'req-083b6bca-941c-4ac1-a4f5-d3653e62b23f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:08.753736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] The token cache is being invalidate because project 0c489229b8a34b899bb3852aefa0b740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:54:08.754404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:08.755196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:08.757128 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1143/2300] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:54:08 2022] DELETE /identity/v3/projects/0c489229b8a34b899bb3852aefa0b740 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:08.761195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c5cd0-e4d7-4eae-b1ed-61b49558dca2 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:08.774046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c5cd0-e4d7-4eae-b1ed-61b49558dca2 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:08.915647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634b463-4df3-4edd-b5bc-36d00423a266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:08.916721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634b463-4df3-4edd-b5bc-36d00423a266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:08.917764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634b463-4df3-4edd-b5bc-36d00423a266 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:08.918102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634b463-4df3-4edd-b5bc-36d00423a266 admin admin] PATH_INFO: `/v3/users/b892e2b7a93b4c00909b3ca285507261` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:08.920287 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634b463-4df3-4edd-b5bc-36d00423a266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b892e2b7a93b4c00909b3ca285507261)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:08.922928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634b463-4df3-4edd-b5bc-36d00423a266 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:09.014563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-5634b463-4df3-4edd-b5bc-36d00423a266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b892e2b7a93b4c00909b3ca285507261'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:09.042229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-5634b463-4df3-4edd-b5bc-36d00423a266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b892e2b7a93b4c00909b3ca285507261'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:09.043403 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-5634b463-4df3-4edd-b5bc-36d00423a266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b892e2b7a93b4c00909b3ca285507261'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:09.044721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-5634b463-4df3-4edd-b5bc-36d00423a266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b892e2b7a93b4c00909b3ca285507261'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:09.058024 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-5634b463-4df3-4edd-b5bc-36d00423a266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b892e2b7a93b4c00909b3ca285507261'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:09.076297 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1158/2301] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:54:08 2022] DELETE /identity/v3/users/b892e2b7a93b4c00909b3ca285507261 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:09.486182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:09.487975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:09.504139 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b6bca-941c-4ac1-a4f5-d3653e62b23f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:09.565873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:09.566729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:09.567045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:09.567319 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] PATH_INFO: `/v3/projects/d0c2c20ba6a64cb8970afafc3d6e28b1` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:09.568580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c2c20ba6a64cb8970afafc3d6e28b1)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:09.570480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:09.624702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c2c20ba6a64cb8970afafc3d6e28b1', 'request_id': 'req-a33cb145-f7bc-466d-83a1-3deb122ff410'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:09.632849 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c2c20ba6a64cb8970afafc3d6e28b1', 'request_id': 'req-a33cb145-f7bc-466d-83a1-3deb122ff410'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:09.639373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c2c20ba6a64cb8970afafc3d6e28b1', 'request_id': 'req-a33cb145-f7bc-466d-83a1-3deb122ff410'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:09.650339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] The token cache is being invalidate because project d0c2c20ba6a64cb8970afafc3d6e28b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:54:09.650627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:09.651305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a33cb145-f7bc-466d-83a1-3deb122ff410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:09.652838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1144/2302] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:54:09 2022] DELETE /identity/v3/projects/d0c2c20ba6a64cb8970afafc3d6e28b1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:09.659289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607ddde-e1bf-4892-8274-22bee77365d5 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:09.659584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607ddde-e1bf-4892-8274-22bee77365d5 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:09.659980 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607ddde-e1bf-4892-8274-22bee77365d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:09.678117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5607ddde-e1bf-4892-8274-22bee77365d5 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:09.679359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5607ddde-e1bf-4892-8274-22bee77365d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:09.740491 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1159/2303] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:09.748325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cd2cc-aed1-46ac-b188-3913ecd4d0b7 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:09.748613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cd2cc-aed1-46ac-b188-3913ecd4d0b7 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:09.748894 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cd2cc-aed1-46ac-b188-3913ecd4d0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:09.767402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d70cd2cc-aed1-46ac-b188-3913ecd4d0b7 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:09.769156 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d70cd2cc-aed1-46ac-b188-3913ecd4d0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:09.777099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1145/2304] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:09.781249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607ddde-e1bf-4892-8274-22bee77365d5 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:09.791325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607ddde-e1bf-4892-8274-22bee77365d5 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:09.796511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d48d-5008-421a-897f-9128182ead90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:09.797158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d48d-5008-421a-897f-9128182ead90 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:09.797438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d48d-5008-421a-897f-9128182ead90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:09.797741 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d48d-5008-421a-897f-9128182ead90 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:09.798474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65d48d-5008-421a-897f-9128182ead90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:54:09.798803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65d48d-5008-421a-897f-9128182ead90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:09.800631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65d48d-5008-421a-897f-9128182ead90 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:09.813087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1160/2305] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:54:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:54:09.818920 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cd2cc-aed1-46ac-b188-3913ecd4d0b7 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:09.829765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cd2cc-aed1-46ac-b188-3913ecd4d0b7 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:09.835849 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cefde4-cb33-4c7b-9355-f43bf497370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:09.836501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefde4-cb33-4c7b-9355-f43bf497370c admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:09.836786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefde4-cb33-4c7b-9355-f43bf497370c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:09.837058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefde4-cb33-4c7b-9355-f43bf497370c admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:09.837784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cefde4-cb33-4c7b-9355-f43bf497370c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:09.840231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cefde4-cb33-4c7b-9355-f43bf497370c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:09.874155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1146/2306] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:54:09 2022] POST /identity/v3/projects => generated 378 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:09.875952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d48d-5008-421a-897f-9128182ead90 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:09.893831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d48d-5008-421a-897f-9128182ead90 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:09.957875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bc57b-b0a7-42ac-ace3-1cbaf9ce0de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:09.958554 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bc57b-b0a7-42ac-ace3-1cbaf9ce0de6 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:09.958993 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bc57b-b0a7-42ac-ace3-1cbaf9ce0de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:09.959270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bc57b-b0a7-42ac-ace3-1cbaf9ce0de6 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:09.959977 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bc57b-b0a7-42ac-ace3-1cbaf9ce0de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:09.961854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bc57b-b0a7-42ac-ace3-1cbaf9ce0de6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:09.986963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1161/2307] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:54:09 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:09.990704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cefde4-cb33-4c7b-9355-f43bf497370c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:10.001036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cefde4-cb33-4c7b-9355-f43bf497370c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:10.006911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19260-7306-4209-aad9-248a69cd9248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:10.007601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19260-7306-4209-aad9-248a69cd9248 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.007913 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19260-7306-4209-aad9-248a69cd9248 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.008227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19260-7306-4209-aad9-248a69cd9248 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.009184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee19260-7306-4209-aad9-248a69cd9248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:10.010799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee19260-7306-4209-aad9-248a69cd9248 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:10.022166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1147/2308] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:09 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:10.026330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bc57b-b0a7-42ac-ace3-1cbaf9ce0de6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:10.037461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bc57b-b0a7-42ac-ace3-1cbaf9ce0de6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:10.042091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e832d-a3c5-4180-a6e3-165d86edbbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:10.042762 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e832d-a3c5-4180-a6e3-165d86edbbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.043057 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e832d-a3c5-4180-a6e3-165d86edbbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.043337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e832d-a3c5-4180-a6e3-165d86edbbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.044077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e832d-a3c5-4180-a6e3-165d86edbbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:10.045648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e832d-a3c5-4180-a6e3-165d86edbbe1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:10.056280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1162/2309] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:10 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:10.060697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19260-7306-4209-aad9-248a69cd9248 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:10.071174 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19260-7306-4209-aad9-248a69cd9248 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:10.075790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8689-6d21-491c-82f2-bcec0a6c11e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:10.076663 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8689-6d21-491c-82f2-bcec0a6c11e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.076948 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8689-6d21-491c-82f2-bcec0a6c11e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.077226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8689-6d21-491c-82f2-bcec0a6c11e9 admin admin] PATH_INFO: `/v3/projects/de2a2c6e29364cd18cbc5d160ea4bd5c/users/288856ba12f14189b7b9546a2d581797/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.092179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab8689-6d21-491c-82f2-bcec0a6c11e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2a2c6e29364cd18cbc5d160ea4bd5c, user_id=288856ba12f14189b7b9546a2d581797, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:10.094952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab8689-6d21-491c-82f2-bcec0a6c11e9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:10.108561 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1148/2310] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:10 2022] PUT /identity/v3/projects/de2a2c6e29364cd18cbc5d160ea4bd5c/users/288856ba12f14189b7b9546a2d581797/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:10.120809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fd3d6-a4bc-470a-8675-29c1128cb8d4 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.121106 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fd3d6-a4bc-470a-8675-29c1128cb8d4 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.121383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fd3d6-a4bc-470a-8675-29c1128cb8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.148657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-db9fd3d6-a4bc-470a-8675-29c1128cb8d4 None None] MFA Rules not processed for user `288856ba12f14189b7b9546a2d581797`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:10.149856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-db9fd3d6-a4bc-470a-8675-29c1128cb8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:10.212960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1163/2311] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:10.217399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8689-6d21-491c-82f2-bcec0a6c11e9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:10.277153 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8689-6d21-491c-82f2-bcec0a6c11e9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:10.282225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9a8f2-e7fa-482f-8cdf-4934ba833fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:10.282912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a8f2-e7fa-482f-8cdf-4934ba833fba admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.283242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a8f2-e7fa-482f-8cdf-4934ba833fba admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.283528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a8f2-e7fa-482f-8cdf-4934ba833fba admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.284424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9a8f2-e7fa-482f-8cdf-4934ba833fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:10.286326 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9a8f2-e7fa-482f-8cdf-4934ba833fba admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:10.322947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1149/2312] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:54:10 2022] POST /identity/v3/projects => generated 376 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:54:10.324114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fd3d6-a4bc-470a-8675-29c1128cb8d4 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:10.334828 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fd3d6-a4bc-470a-8675-29c1128cb8d4 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:10.390456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b3594-1a13-4427-8e85-437f760700be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:10.391143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b3594-1a13-4427-8e85-437f760700be admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.391452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b3594-1a13-4427-8e85-437f760700be admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.391751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b3594-1a13-4427-8e85-437f760700be admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.392414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b3594-1a13-4427-8e85-437f760700be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:10.394907 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b3594-1a13-4427-8e85-437f760700be admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:10.419962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1164/2313] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:54:10 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:10.421150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9a8f2-e7fa-482f-8cdf-4934ba833fba admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:10.432624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9a8f2-e7fa-482f-8cdf-4934ba833fba admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:10.437845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdf922-4aed-47ff-bb6c-1a33fd76f406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:10.438507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf922-4aed-47ff-bb6c-1a33fd76f406 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.438827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf922-4aed-47ff-bb6c-1a33fd76f406 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.439139 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf922-4aed-47ff-bb6c-1a33fd76f406 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.439977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdf922-4aed-47ff-bb6c-1a33fd76f406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:10.441624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdf922-4aed-47ff-bb6c-1a33fd76f406 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:10.452477 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1150/2314] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:10 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:10.456955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b3594-1a13-4427-8e85-437f760700be admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:10.467321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b3594-1a13-4427-8e85-437f760700be admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:10.472534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8801a-4c26-4f34-9ed1-d7ebba8e6c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:10.473400 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8801a-4c26-4f34-9ed1-d7ebba8e6c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.473681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8801a-4c26-4f34-9ed1-d7ebba8e6c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.473956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8801a-4c26-4f34-9ed1-d7ebba8e6c27 admin admin] PATH_INFO: `/v3/projects/c00dd28dfb4a45109277f83cd05d40a8/users/bb7b65fc9e744f78a46729ea28c95b18/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.489559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8801a-4c26-4f34-9ed1-d7ebba8e6c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00dd28dfb4a45109277f83cd05d40a8, user_id=bb7b65fc9e744f78a46729ea28c95b18, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:10.492305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8801a-4c26-4f34-9ed1-d7ebba8e6c27 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:10.505506 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1165/2315] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:10 2022] PUT /identity/v3/projects/c00dd28dfb4a45109277f83cd05d40a8/users/bb7b65fc9e744f78a46729ea28c95b18/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:10.509705 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdf922-4aed-47ff-bb6c-1a33fd76f406 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:10.522856 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdf922-4aed-47ff-bb6c-1a33fd76f406 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:10.580800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca929-ee21-43e3-a111-917d76346e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:10.581484 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca929-ee21-43e3-a111-917d76346e69 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.581746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca929-ee21-43e3-a111-917d76346e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.582015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca929-ee21-43e3-a111-917d76346e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.582763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca929-ee21-43e3-a111-917d76346e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:10.584351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca929-ee21-43e3-a111-917d76346e69 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:10.593636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1151/2316] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:10 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:10.598324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8801a-4c26-4f34-9ed1-d7ebba8e6c27 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:10.608789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8801a-4c26-4f34-9ed1-d7ebba8e6c27 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:10.613992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bac47a-5486-478f-97db-6f499dac2c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:10.614901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac47a-5486-478f-97db-6f499dac2c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.615182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac47a-5486-478f-97db-6f499dac2c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.615459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac47a-5486-478f-97db-6f499dac2c7e admin admin] PATH_INFO: `/v3/projects/c00dd28dfb4a45109277f83cd05d40a8/users/bb7b65fc9e744f78a46729ea28c95b18/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.617589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bac47a-5486-478f-97db-6f499dac2c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00dd28dfb4a45109277f83cd05d40a8, user_id=bb7b65fc9e744f78a46729ea28c95b18, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:10.620322 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bac47a-5486-478f-97db-6f499dac2c7e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:10.630828 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1166/2317] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:10 2022] PUT /identity/v3/projects/c00dd28dfb4a45109277f83cd05d40a8/users/bb7b65fc9e744f78a46729ea28c95b18/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:10.642020 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ff55-2f87-48c8-9dd4-aed14bbae994 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.642559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ff55-2f87-48c8-9dd4-aed14bbae994 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.642660 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ff55-2f87-48c8-9dd4-aed14bbae994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.669724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7bc7ff55-2f87-48c8-9dd4-aed14bbae994 None None] MFA Rules not processed for user `bb7b65fc9e744f78a46729ea28c95b18`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:10.670981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7bc7ff55-2f87-48c8-9dd4-aed14bbae994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:10.740159 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1152/2318] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:10.749488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bac47a-5486-478f-97db-6f499dac2c7e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:10.751222 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-78bac47a-5486-478f-97db-6f499dac2c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:10.807669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bac47a-5486-478f-97db-6f499dac2c7e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:10.811300 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc95198-fd2d-42eb-a024-8b34cd80c70f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:10.811920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95198-fd2d-42eb-a024-8b34cd80c70f service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:10.812204 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95198-fd2d-42eb-a024-8b34cd80c70f service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:10.812476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95198-fd2d-42eb-a024-8b34cd80c70f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:10.865865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc95198-fd2d-42eb-a024-8b34cd80c70f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:10.867321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc95198-fd2d-42eb-a024-8b34cd80c70f service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:10.875824 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1167/2319] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:16.477917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7ff55-2f87-48c8-9dd4-aed14bbae994 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:16.488061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7ff55-2f87-48c8-9dd4-aed14bbae994 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:16.491532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff18eb-b8d0-4307-9566-6886a6c9afb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:16.492164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff18eb-b8d0-4307-9566-6886a6c9afb4 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:16.492441 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff18eb-b8d0-4307-9566-6886a6c9afb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:16.492712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff18eb-b8d0-4307-9566-6886a6c9afb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:16.502034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff18eb-b8d0-4307-9566-6886a6c9afb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:16.503485 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff18eb-b8d0-4307-9566-6886a6c9afb4 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:16.513057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1153/2320] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:17.629109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc95198-fd2d-42eb-a024-8b34cd80c70f service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:17.630539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ecc95198-fd2d-42eb-a024-8b34cd80c70f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:17.686429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc95198-fd2d-42eb-a024-8b34cd80c70f service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:17.690195 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207be6e7-6f78-474e-8309-03f299c271cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:17.690876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be6e7-6f78-474e-8309-03f299c271cb service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:17.691160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be6e7-6f78-474e-8309-03f299c271cb service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:17.691449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be6e7-6f78-474e-8309-03f299c271cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:17.693243 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-207be6e7-6f78-474e-8309-03f299c271cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:17.755158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207be6e7-6f78-474e-8309-03f299c271cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:17.756591 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207be6e7-6f78-474e-8309-03f299c271cb service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:17.766235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1168/2321] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:27.970187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f261e4a-8ba3-4e12-b755-09a5bdb5d255 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:27.970187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f261e4a-8ba3-4e12-b755-09a5bdb5d255 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:27.971165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f261e4a-8ba3-4e12-b755-09a5bdb5d255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:27.989588 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-9f261e4a-8ba3-4e12-b755-09a5bdb5d255 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:27.992205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9f261e4a-8ba3-4e12-b755-09a5bdb5d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:28.061059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1154/2322] 10.222.0.117 () {58 vars in 972 bytes} [Mon Jan 24 16:54:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:28.085365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207be6e7-6f78-474e-8309-03f299c271cb service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:28.086981 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-207be6e7-6f78-474e-8309-03f299c271cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:28.166087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207be6e7-6f78-474e-8309-03f299c271cb service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:28.171731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2595e9-3d02-4dd9-b37e-27c70ad877cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:28.172524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2595e9-3d02-4dd9-b37e-27c70ad877cc service swift] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:28.172845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2595e9-3d02-4dd9-b37e-27c70ad877cc service swift] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:28.173280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2595e9-3d02-4dd9-b37e-27c70ad877cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:28.182131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2595e9-3d02-4dd9-b37e-27c70ad877cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:28.183752 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2595e9-3d02-4dd9-b37e-27c70ad877cc service swift] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:28.191860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1169/2323] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:54:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:54:45.308569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f261e4a-8ba3-4e12-b755-09a5bdb5d255 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:45.310120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9f261e4a-8ba3-4e12-b755-09a5bdb5d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:45.374525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f261e4a-8ba3-4e12-b755-09a5bdb5d255 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:45.379202 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67a4cd-fa21-4abb-a32b-bd9a80fde3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:45.380055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67a4cd-fa21-4abb-a32b-bd9a80fde3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:45.380369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67a4cd-fa21-4abb-a32b-bd9a80fde3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:45.380645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67a4cd-fa21-4abb-a32b-bd9a80fde3c4 admin admin] PATH_INFO: `/v3/users/f86b459cc02f4f38a2ced5f25972535f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:45.381877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67a4cd-fa21-4abb-a32b-bd9a80fde3c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86b459cc02f4f38a2ced5f25972535f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:45.383833 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67a4cd-fa21-4abb-a32b-bd9a80fde3c4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:45.430115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6a67a4cd-fa21-4abb-a32b-bd9a80fde3c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86b459cc02f4f38a2ced5f25972535f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:45.437737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6a67a4cd-fa21-4abb-a32b-bd9a80fde3c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86b459cc02f4f38a2ced5f25972535f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:45.444733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6a67a4cd-fa21-4abb-a32b-bd9a80fde3c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86b459cc02f4f38a2ced5f25972535f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:45.457078 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6a67a4cd-fa21-4abb-a32b-bd9a80fde3c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86b459cc02f4f38a2ced5f25972535f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:45.457726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6a67a4cd-fa21-4abb-a32b-bd9a80fde3c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86b459cc02f4f38a2ced5f25972535f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:45.464278 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1155/2324] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:54:45 2022] DELETE /identity/v3/users/f86b459cc02f4f38a2ced5f25972535f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:54:45.638354 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2595e9-3d02-4dd9-b37e-27c70ad877cc service swift] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:45.650962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2595e9-3d02-4dd9-b37e-27c70ad877cc service swift] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:45.710677 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:45.711565 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:45.711849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:45.712127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] PATH_INFO: `/v3/projects/bed4ca830bf54f2493c46fb3cf3fbbc6` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:45.713337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed4ca830bf54f2493c46fb3cf3fbbc6)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:45.715260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:45.761630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'request_id': 'req-fd02e1ff-99c7-4538-ac94-632e531b209b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:45.767235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'request_id': 'req-fd02e1ff-99c7-4538-ac94-632e531b209b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:45.774343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'request_id': 'req-fd02e1ff-99c7-4538-ac94-632e531b209b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:45.785614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] The token cache is being invalidate because project bed4ca830bf54f2493c46fb3cf3fbbc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:54:45.785901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:45.786530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-fd02e1ff-99c7-4538-ac94-632e531b209b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:45.788387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1170/2325] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:54:45 2022] DELETE /identity/v3/projects/bed4ca830bf54f2493c46fb3cf3fbbc6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:45.797402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f959-3d23-4dca-887e-01ef464cab27 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:45.797402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f959-3d23-4dca-887e-01ef464cab27 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:45.797673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f959-3d23-4dca-887e-01ef464cab27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:45.816952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-9872f959-3d23-4dca-887e-01ef464cab27 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:45.818205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9872f959-3d23-4dca-887e-01ef464cab27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:45.878601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1156/2326] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:45.886824 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac24ca-d09b-42cd-863b-2eaf3a615411 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:45.887112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac24ca-d09b-42cd-863b-2eaf3a615411 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:45.887388 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac24ca-d09b-42cd-863b-2eaf3a615411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:45.906185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-12ac24ca-d09b-42cd-863b-2eaf3a615411 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:45.907436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-12ac24ca-d09b-42cd-863b-2eaf3a615411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:45.915433 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1171/2327] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:45.919678 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872f959-3d23-4dca-887e-01ef464cab27 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:45.930202 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872f959-3d23-4dca-887e-01ef464cab27 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:45.935109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadee542-9d7c-40d9-8228-2c0a4ed7c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:45.935756 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadee542-9d7c-40d9-8228-2c0a4ed7c5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:45.936263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadee542-9d7c-40d9-8228-2c0a4ed7c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:45.936544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadee542-9d7c-40d9-8228-2c0a4ed7c5c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:45.937342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadee542-9d7c-40d9-8228-2c0a4ed7c5c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:54:45.937652 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadee542-9d7c-40d9-8228-2c0a4ed7c5c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:45.939283 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadee542-9d7c-40d9-8228-2c0a4ed7c5c1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:45.951834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1157/2328] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:54:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:54:45.956216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac24ca-d09b-42cd-863b-2eaf3a615411 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:45.965351 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac24ca-d09b-42cd-863b-2eaf3a615411 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:45.970419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f615d-c0e6-4e3e-9ea1-a404a1ff4648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:45.971107 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f615d-c0e6-4e3e-9ea1-a404a1ff4648 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:45.971386 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f615d-c0e6-4e3e-9ea1-a404a1ff4648 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:45.971657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f615d-c0e6-4e3e-9ea1-a404a1ff4648 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:45.972357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f615d-c0e6-4e3e-9ea1-a404a1ff4648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:45.974300 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f615d-c0e6-4e3e-9ea1-a404a1ff4648 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:46.001472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1172/2329] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:54:45 2022] POST /identity/v3/projects => generated 366 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:46.005507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadee542-9d7c-40d9-8228-2c0a4ed7c5c1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:46.016345 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadee542-9d7c-40d9-8228-2c0a4ed7c5c1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:46.072159 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf1e10-210a-4ced-9db9-2a9c76e9ef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:46.072750 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf1e10-210a-4ced-9db9-2a9c76e9ef11 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:46.073035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf1e10-210a-4ced-9db9-2a9c76e9ef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:46.073315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf1e10-210a-4ced-9db9-2a9c76e9ef11 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:46.074028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf1e10-210a-4ced-9db9-2a9c76e9ef11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:46.075991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf1e10-210a-4ced-9db9-2a9c76e9ef11 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:46.094959 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1158/2330] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:54:46 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:46.099256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f615d-c0e6-4e3e-9ea1-a404a1ff4648 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:46.109707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f615d-c0e6-4e3e-9ea1-a404a1ff4648 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:46.114477 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316c5a2-9133-41c4-b93d-8716b08690a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:46.115153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316c5a2-9133-41c4-b93d-8716b08690a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:46.115420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316c5a2-9133-41c4-b93d-8716b08690a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:46.115690 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316c5a2-9133-41c4-b93d-8716b08690a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:46.116443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316c5a2-9133-41c4-b93d-8716b08690a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:46.118008 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316c5a2-9133-41c4-b93d-8716b08690a5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:46.128972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1173/2331] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:46 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:46.137290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf1e10-210a-4ced-9db9-2a9c76e9ef11 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:46.147873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf1e10-210a-4ced-9db9-2a9c76e9ef11 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:46.152938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d930-2fc1-4a2f-aa17-1ac9f1783540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:46.153652 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d930-2fc1-4a2f-aa17-1ac9f1783540 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:46.153930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d930-2fc1-4a2f-aa17-1ac9f1783540 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:46.154204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d930-2fc1-4a2f-aa17-1ac9f1783540 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:46.155030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2d930-2fc1-4a2f-aa17-1ac9f1783540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:46.156907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2d930-2fc1-4a2f-aa17-1ac9f1783540 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:46.167188 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1159/2332] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:46 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:54:46.172061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316c5a2-9133-41c4-b93d-8716b08690a5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:46.182164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316c5a2-9133-41c4-b93d-8716b08690a5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:46.187732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d455b-5dac-4df8-8512-f64d70f3d0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:46.188615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d455b-5dac-4df8-8512-f64d70f3d0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:46.188898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d455b-5dac-4df8-8512-f64d70f3d0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:46.189310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d455b-5dac-4df8-8512-f64d70f3d0d9 admin admin] PATH_INFO: `/v3/projects/f3b257e02c5e4443a0e2df18b0e0bd2a/users/1a963a0f13ac4c1f9bb725bf0766d813/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:46.205326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d455b-5dac-4df8-8512-f64d70f3d0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b257e02c5e4443a0e2df18b0e0bd2a, user_id=1a963a0f13ac4c1f9bb725bf0766d813, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:46.208355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d455b-5dac-4df8-8512-f64d70f3d0d9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:46.222578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1174/2333] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:46 2022] PUT /identity/v3/projects/f3b257e02c5e4443a0e2df18b0e0bd2a/users/1a963a0f13ac4c1f9bb725bf0766d813/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:54:46.232592 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376df47-365d-4fc9-a8d9-a9fa57579d13 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:46.232876 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376df47-365d-4fc9-a8d9-a9fa57579d13 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:46.233150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376df47-365d-4fc9-a8d9-a9fa57579d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:46.260191 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-4376df47-365d-4fc9-a8d9-a9fa57579d13 None None] MFA Rules not processed for user `1a963a0f13ac4c1f9bb725bf0766d813`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:46.261378 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-4376df47-365d-4fc9-a8d9-a9fa57579d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:46.331478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1160/2334] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:54:46.337693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d455b-5dac-4df8-8512-f64d70f3d0d9 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:46.340100 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-955d455b-5dac-4df8-8512-f64d70f3d0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:46.398620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d455b-5dac-4df8-8512-f64d70f3d0d9 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:46.402308 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796309f7-496f-4f7d-9b64-27de1f2e2293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:46.403009 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796309f7-496f-4f7d-9b64-27de1f2e2293 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:46.403337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796309f7-496f-4f7d-9b64-27de1f2e2293 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:46.403712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796309f7-496f-4f7d-9b64-27de1f2e2293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:46.412757 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796309f7-496f-4f7d-9b64-27de1f2e2293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:46.414469 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796309f7-496f-4f7d-9b64-27de1f2e2293 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:46.424617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1175/2335] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:47.429191 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376df47-365d-4fc9-a8d9-a9fa57579d13 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:47.430974 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-4376df47-365d-4fc9-a8d9-a9fa57579d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:47.497584 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376df47-365d-4fc9-a8d9-a9fa57579d13 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:47.502633 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:47.503525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:47.503801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:47.504088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] PATH_INFO: `/v3/users/288856ba12f14189b7b9546a2d581797` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:47.505347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=288856ba12f14189b7b9546a2d581797)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:47.507315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:47.554789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288856ba12f14189b7b9546a2d581797'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:47.562825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288856ba12f14189b7b9546a2d581797'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:47.569495 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288856ba12f14189b7b9546a2d581797'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:47.581540 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288856ba12f14189b7b9546a2d581797'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:47.582193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288856ba12f14189b7b9546a2d581797'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:47.587943 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1161/2336] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:54:47 2022] DELETE /identity/v3/users/288856ba12f14189b7b9546a2d581797 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:47.592419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb69ec-fb55-4392-8a51-b1c5bdf53a69 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:47.593503 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb69ec-fb55-4392-8a51-b1c5bdf53a69 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:47.593986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb69ec-fb55-4392-8a51-b1c5bdf53a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:47.611541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-7efb69ec-fb55-4392-8a51-b1c5bdf53a69 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:47.612752 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7efb69ec-fb55-4392-8a51-b1c5bdf53a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:47.668858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1176/2337] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:47.678307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:47.679758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:47.737121 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b199243-7f31-4b82-81c2-02a541d2baa6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:47.740827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c408697-973e-469f-821a-d8076aa72152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:47.741490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c408697-973e-469f-821a-d8076aa72152 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:47.741767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c408697-973e-469f-821a-d8076aa72152 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:47.742038 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c408697-973e-469f-821a-d8076aa72152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:47.751625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c408697-973e-469f-821a-d8076aa72152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:47.753047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c408697-973e-469f-821a-d8076aa72152 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:47.762653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1162/2338] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:48.055043 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb69ec-fb55-4392-8a51-b1c5bdf53a69 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:48.056755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7efb69ec-fb55-4392-8a51-b1c5bdf53a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:48.070430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb69ec-fb55-4392-8a51-b1c5bdf53a69 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:48.075682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:48.076578 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:48.076867 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:48.077141 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] PATH_INFO: `/v3/projects/de2a2c6e29364cd18cbc5d160ea4bd5c` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:48.078956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2a2c6e29364cd18cbc5d160ea4bd5c)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:48.081187 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:48.146873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2a2c6e29364cd18cbc5d160ea4bd5c', 'request_id': 'req-6f36c749-b6d3-4e30-add0-c2e96af5463e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.152309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2a2c6e29364cd18cbc5d160ea4bd5c', 'request_id': 'req-6f36c749-b6d3-4e30-add0-c2e96af5463e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.160492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2a2c6e29364cd18cbc5d160ea4bd5c', 'request_id': 'req-6f36c749-b6d3-4e30-add0-c2e96af5463e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.172229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] The token cache is being invalidate because project de2a2c6e29364cd18cbc5d160ea4bd5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:54:48.172513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.173136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.174698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1177/2339] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:54:48 2022] DELETE /identity/v3/projects/de2a2c6e29364cd18cbc5d160ea4bd5c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:48.178661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c408697-973e-469f-821a-d8076aa72152 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:48.189204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c408697-973e-469f-821a-d8076aa72152 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:48.244809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b84b8b-ecf3-4622-b230-80613a53486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:48.245665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b84b8b-ecf3-4622-b230-80613a53486c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:48.245948 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b84b8b-ecf3-4622-b230-80613a53486c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:48.246219 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b84b8b-ecf3-4622-b230-80613a53486c admin admin] PATH_INFO: `/v3/users/bb7b65fc9e744f78a46729ea28c95b18` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:48.247431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b84b8b-ecf3-4622-b230-80613a53486c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7b65fc9e744f78a46729ea28c95b18)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:48.249565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b84b8b-ecf3-4622-b230-80613a53486c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:48.294026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-76b84b8b-ecf3-4622-b230-80613a53486c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7b65fc9e744f78a46729ea28c95b18'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.302385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-76b84b8b-ecf3-4622-b230-80613a53486c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7b65fc9e744f78a46729ea28c95b18'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.309514 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-76b84b8b-ecf3-4622-b230-80613a53486c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7b65fc9e744f78a46729ea28c95b18'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.321163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-76b84b8b-ecf3-4622-b230-80613a53486c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7b65fc9e744f78a46729ea28c95b18'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.321803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-76b84b8b-ecf3-4622-b230-80613a53486c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7b65fc9e744f78a46729ea28c95b18'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.328982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1163/2340] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:54:48 2022] DELETE /identity/v3/users/bb7b65fc9e744f78a46729ea28c95b18 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:48.592935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:48.594984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:48.609172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36c749-b6d3-4e30-add0-c2e96af5463e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:48.674605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:48.675516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:48.675798 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:48.676071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] PATH_INFO: `/v3/projects/c00dd28dfb4a45109277f83cd05d40a8` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:48.677256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00dd28dfb4a45109277f83cd05d40a8)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:48.679185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:48.726225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00dd28dfb4a45109277f83cd05d40a8', 'request_id': 'req-60244644-146e-4889-82fe-5332817c00b0'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.731460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00dd28dfb4a45109277f83cd05d40a8', 'request_id': 'req-60244644-146e-4889-82fe-5332817c00b0'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.739324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00dd28dfb4a45109277f83cd05d40a8', 'request_id': 'req-60244644-146e-4889-82fe-5332817c00b0'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.750626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] The token cache is being invalidate because project c00dd28dfb4a45109277f83cd05d40a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:54:48.750946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.751575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-60244644-146e-4889-82fe-5332817c00b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:48.753109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1178/2341] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:54:48 2022] DELETE /identity/v3/projects/c00dd28dfb4a45109277f83cd05d40a8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:48.758729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a9e4-fc6f-407c-a9da-ce4b1ef5b6bb None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:48.759234 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a9e4-fc6f-407c-a9da-ce4b1ef5b6bb None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:48.759340 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a9e4-fc6f-407c-a9da-ce4b1ef5b6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:48.776851 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b945a9e4-fc6f-407c-a9da-ce4b1ef5b6bb None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:48.778042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b945a9e4-fc6f-407c-a9da-ce4b1ef5b6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:48.833986 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1164/2342] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:48.841487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c29c8-3a2a-40ef-a5db-677656660d77 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:48.841775 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c29c8-3a2a-40ef-a5db-677656660d77 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:48.842051 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c29c8-3a2a-40ef-a5db-677656660d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:48.861158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-c59c29c8-3a2a-40ef-a5db-677656660d77 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:48.862328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c59c29c8-3a2a-40ef-a5db-677656660d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:48.870041 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1179/2343] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:48.874132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a9e4-fc6f-407c-a9da-ce4b1ef5b6bb None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:48.883523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a9e4-fc6f-407c-a9da-ce4b1ef5b6bb None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:48.888035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a784a0d-88bb-487b-b641-8de072deaf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:48.888672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784a0d-88bb-487b-b641-8de072deaf81 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:48.888952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784a0d-88bb-487b-b641-8de072deaf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:48.889224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784a0d-88bb-487b-b641-8de072deaf81 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:48.890046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a784a0d-88bb-487b-b641-8de072deaf81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:54:48.890351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a784a0d-88bb-487b-b641-8de072deaf81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:48.892042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a784a0d-88bb-487b-b641-8de072deaf81 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:48.903236 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1165/2344] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:54:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:54:48.908193 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c29c8-3a2a-40ef-a5db-677656660d77 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:48.917138 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c29c8-3a2a-40ef-a5db-677656660d77 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:48.922422 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a80c65-d0ee-4d19-8fb2-345cebcb3044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:48.923099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80c65-d0ee-4d19-8fb2-345cebcb3044 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:48.923382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80c65-d0ee-4d19-8fb2-345cebcb3044 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:48.923657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80c65-d0ee-4d19-8fb2-345cebcb3044 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:48.924371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a80c65-d0ee-4d19-8fb2-345cebcb3044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:48.926250 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a80c65-d0ee-4d19-8fb2-345cebcb3044 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:48.951936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1180/2345] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:54:48 2022] POST /identity/v3/projects => generated 370 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:48.956235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a784a0d-88bb-487b-b641-8de072deaf81 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:48.965985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a784a0d-88bb-487b-b641-8de072deaf81 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.020870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c2a4e-f231-4a9d-b9f3-1eaf1879239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.021445 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c2a4e-f231-4a9d-b9f3-1eaf1879239c admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.021725 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c2a4e-f231-4a9d-b9f3-1eaf1879239c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.021997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c2a4e-f231-4a9d-b9f3-1eaf1879239c admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.022696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c2a4e-f231-4a9d-b9f3-1eaf1879239c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:49.024626 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c2a4e-f231-4a9d-b9f3-1eaf1879239c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:49.044497 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1166/2346] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:54:48 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:49.048992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a80c65-d0ee-4d19-8fb2-345cebcb3044 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:49.059144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a80c65-d0ee-4d19-8fb2-345cebcb3044 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.065493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9dfb0-b00e-4ed6-8ae9-c68b1458a86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.066136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9dfb0-b00e-4ed6-8ae9-c68b1458a86b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.066420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9dfb0-b00e-4ed6-8ae9-c68b1458a86b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.066705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9dfb0-b00e-4ed6-8ae9-c68b1458a86b admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.067468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9dfb0-b00e-4ed6-8ae9-c68b1458a86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:49.069047 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9dfb0-b00e-4ed6-8ae9-c68b1458a86b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:49.080712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1181/2347] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:49 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:49.084531 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c2a4e-f231-4a9d-b9f3-1eaf1879239c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:49.095232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c2a4e-f231-4a9d-b9f3-1eaf1879239c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.100038 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422beb0-e94c-4c5d-bc3f-5b1e053d5a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.100751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422beb0-e94c-4c5d-bc3f-5b1e053d5a4a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.100963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422beb0-e94c-4c5d-bc3f-5b1e053d5a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.101240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422beb0-e94c-4c5d-bc3f-5b1e053d5a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.101986 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422beb0-e94c-4c5d-bc3f-5b1e053d5a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:49.103611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422beb0-e94c-4c5d-bc3f-5b1e053d5a4a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:49.113615 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1167/2348] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:49 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:49.117854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9dfb0-b00e-4ed6-8ae9-c68b1458a86b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:49.127829 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9dfb0-b00e-4ed6-8ae9-c68b1458a86b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.132389 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f602a6-6845-4629-b867-83cf0ca0a0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.133264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f602a6-6845-4629-b867-83cf0ca0a0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.133542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f602a6-6845-4629-b867-83cf0ca0a0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.133815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f602a6-6845-4629-b867-83cf0ca0a0e2 admin admin] PATH_INFO: `/v3/projects/1064b876ad1e43298a479e11b2245b71/users/524cc8318075475b8723077c4842c243/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.149343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f602a6-6845-4629-b867-83cf0ca0a0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1064b876ad1e43298a479e11b2245b71, user_id=524cc8318075475b8723077c4842c243, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:49.152036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f602a6-6845-4629-b867-83cf0ca0a0e2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:49.167030 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1182/2349] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:49 2022] PUT /identity/v3/projects/1064b876ad1e43298a479e11b2245b71/users/524cc8318075475b8723077c4842c243/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:49.177961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0298ce-f484-45bb-8ff8-69219847a75b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.178243 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0298ce-f484-45bb-8ff8-69219847a75b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.178519 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0298ce-f484-45bb-8ff8-69219847a75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.205638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-0d0298ce-f484-45bb-8ff8-69219847a75b None None] MFA Rules not processed for user `524cc8318075475b8723077c4842c243`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:49.206861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0d0298ce-f484-45bb-8ff8-69219847a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:49.270273 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1168/2350] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:54:49.275076 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f602a6-6845-4629-b867-83cf0ca0a0e2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:49.340666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f602a6-6845-4629-b867-83cf0ca0a0e2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.346592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767795a-4224-4a19-b478-10772a215d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.347815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767795a-4224-4a19-b478-10772a215d2c admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.348332 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767795a-4224-4a19-b478-10772a215d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.348883 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767795a-4224-4a19-b478-10772a215d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.350526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767795a-4224-4a19-b478-10772a215d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:49.355213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767795a-4224-4a19-b478-10772a215d2c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:49.384976 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1183/2351] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:54:49 2022] POST /identity/v3/projects => generated 368 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:49.388873 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0298ce-f484-45bb-8ff8-69219847a75b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:49.401954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0298ce-f484-45bb-8ff8-69219847a75b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.469257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcc5d0-0909-4cd7-aa0e-baac0b66671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.469257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcc5d0-0909-4cd7-aa0e-baac0b66671c admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.469257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcc5d0-0909-4cd7-aa0e-baac0b66671c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.469257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcc5d0-0909-4cd7-aa0e-baac0b66671c admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.470297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcc5d0-0909-4cd7-aa0e-baac0b66671c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:49.472493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcc5d0-0909-4cd7-aa0e-baac0b66671c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:49.494442 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1169/2352] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:54:49 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:49.498214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767795a-4224-4a19-b478-10772a215d2c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:49.511127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767795a-4224-4a19-b478-10772a215d2c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.516948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e675-2ffb-4fe5-927a-227fd593465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.517615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e675-2ffb-4fe5-927a-227fd593465e admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.517890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e675-2ffb-4fe5-927a-227fd593465e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.518162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e675-2ffb-4fe5-927a-227fd593465e admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.518932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12e675-2ffb-4fe5-927a-227fd593465e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:49.520507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12e675-2ffb-4fe5-927a-227fd593465e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:49.532273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1184/2353] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:49 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:49.536523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcc5d0-0909-4cd7-aa0e-baac0b66671c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:49.547410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcc5d0-0909-4cd7-aa0e-baac0b66671c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.552898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea4b94-847b-4993-9168-9ef629763878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.553925 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea4b94-847b-4993-9168-9ef629763878 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.554242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea4b94-847b-4993-9168-9ef629763878 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.554527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea4b94-847b-4993-9168-9ef629763878 admin admin] PATH_INFO: `/v3/projects/0d400731107348ae8f8ca52170889dfb/users/699ae494099b49aaa663f995b282c7ac/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.570472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea4b94-847b-4993-9168-9ef629763878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d400731107348ae8f8ca52170889dfb, user_id=699ae494099b49aaa663f995b282c7ac, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:49.573183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea4b94-847b-4993-9168-9ef629763878 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:49.586297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1170/2354] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:49 2022] PUT /identity/v3/projects/0d400731107348ae8f8ca52170889dfb/users/699ae494099b49aaa663f995b282c7ac/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:49.590349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e675-2ffb-4fe5-927a-227fd593465e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:49.601227 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e675-2ffb-4fe5-927a-227fd593465e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.668482 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edeebc-b6e0-4a4b-89a2-11302678fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.669208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edeebc-b6e0-4a4b-89a2-11302678fc56 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.669497 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edeebc-b6e0-4a4b-89a2-11302678fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.669772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edeebc-b6e0-4a4b-89a2-11302678fc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.670523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edeebc-b6e0-4a4b-89a2-11302678fc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:49.672933 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edeebc-b6e0-4a4b-89a2-11302678fc56 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:49.683540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1185/2355] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:49 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:49.687578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea4b94-847b-4993-9168-9ef629763878 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:49.698022 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea4b94-847b-4993-9168-9ef629763878 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.702776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4f109-ecea-42ce-afea-9c2a452b937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.703656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4f109-ecea-42ce-afea-9c2a452b937d admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.703944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4f109-ecea-42ce-afea-9c2a452b937d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.704221 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4f109-ecea-42ce-afea-9c2a452b937d admin admin] PATH_INFO: `/v3/projects/0d400731107348ae8f8ca52170889dfb/users/699ae494099b49aaa663f995b282c7ac/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.706191 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4f109-ecea-42ce-afea-9c2a452b937d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d400731107348ae8f8ca52170889dfb, user_id=699ae494099b49aaa663f995b282c7ac, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:49.708928 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4f109-ecea-42ce-afea-9c2a452b937d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:49.720164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1171/2356] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:49 2022] PUT /identity/v3/projects/0d400731107348ae8f8ca52170889dfb/users/699ae494099b49aaa663f995b282c7ac/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:54:49.730540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02b88-02bc-4383-948e-8f8486b84014 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.730680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02b88-02bc-4383-948e-8f8486b84014 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.730989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02b88-02bc-4383-948e-8f8486b84014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.757179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-bbc02b88-02bc-4383-948e-8f8486b84014 None None] MFA Rules not processed for user `699ae494099b49aaa663f995b282c7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:49.758388 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-bbc02b88-02bc-4383-948e-8f8486b84014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:49.826897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1186/2357] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:54:49.837565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4f109-ecea-42ce-afea-9c2a452b937d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:49.839474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a1a4f109-ecea-42ce-afea-9c2a452b937d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:49.898968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4f109-ecea-42ce-afea-9c2a452b937d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.903069 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c45e5-6896-4c19-be96-7e86e7d5d78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.903719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c45e5-6896-4c19-be96-7e86e7d5d78a service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.904005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c45e5-6896-4c19-be96-7e86e7d5d78a service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.904281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c45e5-6896-4c19-be96-7e86e7d5d78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:49.914558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c45e5-6896-4c19-be96-7e86e7d5d78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:49.916018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c45e5-6896-4c19-be96-7e86e7d5d78a service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:49.925806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1172/2358] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:49.969295 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc02b88-02bc-4383-948e-8f8486b84014 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:49.970687 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-bbc02b88-02bc-4383-948e-8f8486b84014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:49.982304 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc02b88-02bc-4383-948e-8f8486b84014 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:49.985998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd325a81-6e67-4f59-9fa7-b42e7dbc46ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:49.986617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325a81-6e67-4f59-9fa7-b42e7dbc46ba service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:49.986936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325a81-6e67-4f59-9fa7-b42e7dbc46ba service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:49.987209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325a81-6e67-4f59-9fa7-b42e7dbc46ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:50.042338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd325a81-6e67-4f59-9fa7-b42e7dbc46ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:50.043807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd325a81-6e67-4f59-9fa7-b42e7dbc46ba service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:50.052528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1187/2359] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:53.241645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c45e5-6896-4c19-be96-7e86e7d5d78a service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:53.304579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c45e5-6896-4c19-be96-7e86e7d5d78a service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:53.310401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:53.311450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:53.311761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:53.312047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] PATH_INFO: `/v3/users/524cc8318075475b8723077c4842c243` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:53.313264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=524cc8318075475b8723077c4842c243)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:53.315252 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:53.364395 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524cc8318075475b8723077c4842c243'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:53.373719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524cc8318075475b8723077c4842c243'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:53.380961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524cc8318075475b8723077c4842c243'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:53.393235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524cc8318075475b8723077c4842c243'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:53.393955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524cc8318075475b8723077c4842c243'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:53.399745 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1173/2360] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:54:53 2022] DELETE /identity/v3/users/524cc8318075475b8723077c4842c243 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:53.405863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1073130-ca26-4e07-9941-8812654b0385 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:53.406500 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1073130-ca26-4e07-9941-8812654b0385 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:53.406607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1073130-ca26-4e07-9941-8812654b0385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:53.423206 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a1073130-ca26-4e07-9941-8812654b0385 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:53.424409 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a1073130-ca26-4e07-9941-8812654b0385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:53.485858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1188/2361] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:53.496017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:53.497457 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:53.558399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4aa265-31c1-4f43-a093-548d1dc153cd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:53.562359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90415207-89e1-4145-9fda-547e68f0824a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:53.563046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90415207-89e1-4145-9fda-547e68f0824a service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:53.563347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90415207-89e1-4145-9fda-547e68f0824a service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:53.563681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90415207-89e1-4145-9fda-547e68f0824a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:53.573852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90415207-89e1-4145-9fda-547e68f0824a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:53.575166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90415207-89e1-4145-9fda-547e68f0824a service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:53.586312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1174/2362] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:53.872261 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1073130-ca26-4e07-9941-8812654b0385 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:53.876597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a1073130-ca26-4e07-9941-8812654b0385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:53.891408 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1073130-ca26-4e07-9941-8812654b0385 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:53.899264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:53.901563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:53.902137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:53.902706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] PATH_INFO: `/v3/projects/1064b876ad1e43298a479e11b2245b71` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:53.904899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1064b876ad1e43298a479e11b2245b71)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:53.909121 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:53.971852 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1064b876ad1e43298a479e11b2245b71', 'request_id': 'req-1dc9061e-dcff-4050-9e5d-1e01f750d520'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:53.978355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1064b876ad1e43298a479e11b2245b71', 'request_id': 'req-1dc9061e-dcff-4050-9e5d-1e01f750d520'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:53.985834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1064b876ad1e43298a479e11b2245b71', 'request_id': 'req-1dc9061e-dcff-4050-9e5d-1e01f750d520'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:53.996444 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] The token cache is being invalidate because project 1064b876ad1e43298a479e11b2245b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:54:53.996728 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:53.997356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:53.999702 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1189/2363] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:54:53 2022] DELETE /identity/v3/projects/1064b876ad1e43298a479e11b2245b71 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:54.003703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90415207-89e1-4145-9fda-547e68f0824a service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:54.013384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90415207-89e1-4145-9fda-547e68f0824a service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:54.069165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9a69c-56a4-4c70-b93a-dc3ba5ce42da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:54.069946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9a69c-56a4-4c70-b93a-dc3ba5ce42da admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:54.070231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9a69c-56a4-4c70-b93a-dc3ba5ce42da admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:54.070507 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9a69c-56a4-4c70-b93a-dc3ba5ce42da admin admin] PATH_INFO: `/v3/users/699ae494099b49aaa663f995b282c7ac` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:54.071746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9a69c-56a4-4c70-b93a-dc3ba5ce42da admin admin] RBAC: Authorizing `identity:delete_user(user_id=699ae494099b49aaa663f995b282c7ac)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:54.073663 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9a69c-56a4-4c70-b93a-dc3ba5ce42da admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:54.117671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-65b9a69c-56a4-4c70-b93a-dc3ba5ce42da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699ae494099b49aaa663f995b282c7ac'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.124993 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-65b9a69c-56a4-4c70-b93a-dc3ba5ce42da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699ae494099b49aaa663f995b282c7ac'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.131767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-65b9a69c-56a4-4c70-b93a-dc3ba5ce42da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699ae494099b49aaa663f995b282c7ac'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.143672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-65b9a69c-56a4-4c70-b93a-dc3ba5ce42da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699ae494099b49aaa663f995b282c7ac'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.144366 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-65b9a69c-56a4-4c70-b93a-dc3ba5ce42da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699ae494099b49aaa663f995b282c7ac'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.150092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1175/2364] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:54:54 2022] DELETE /identity/v3/users/699ae494099b49aaa663f995b282c7ac => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:54.437823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:54.439989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:54.461472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9061e-dcff-4050-9e5d-1e01f750d520 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:54.520323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:54.521177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:54.521454 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:54.521727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] PATH_INFO: `/v3/projects/0d400731107348ae8f8ca52170889dfb` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:54.523016 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d400731107348ae8f8ca52170889dfb)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:54.524901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:54.575879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d400731107348ae8f8ca52170889dfb', 'request_id': 'req-423b1d0f-c7c5-477e-8b0b-694569eecf50'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.582634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d400731107348ae8f8ca52170889dfb', 'request_id': 'req-423b1d0f-c7c5-477e-8b0b-694569eecf50'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.590845 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d400731107348ae8f8ca52170889dfb', 'request_id': 'req-423b1d0f-c7c5-477e-8b0b-694569eecf50'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.602262 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] The token cache is being invalidate because project 0d400731107348ae8f8ca52170889dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:54:54.602496 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.603205 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.604921 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1190/2365] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:54:54 2022] DELETE /identity/v3/projects/0d400731107348ae8f8ca52170889dfb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:54.611272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64433ba1-ce18-42b3-baf7-4fd6a1ef22c1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:54.611780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64433ba1-ce18-42b3-baf7-4fd6a1ef22c1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:54.611979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64433ba1-ce18-42b3-baf7-4fd6a1ef22c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:54.633982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-64433ba1-ce18-42b3-baf7-4fd6a1ef22c1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:54.634829 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-64433ba1-ce18-42b3-baf7-4fd6a1ef22c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:54.666007 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:54.667537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:54.698883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1176/2366] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:54.707258 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce962942-10e1-4fa3-a508-36828d962e32 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:54.707628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce962942-10e1-4fa3-a508-36828d962e32 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:54.707990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce962942-10e1-4fa3-a508-36828d962e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:54.727901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ce962942-10e1-4fa3-a508-36828d962e32 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:54.729102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ce962942-10e1-4fa3-a508-36828d962e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:54.737890 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1177/2367] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:54:54.740309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b1d0f-c7c5-477e-8b0b-694569eecf50 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:54.742136 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce962942-10e1-4fa3-a508-36828d962e32 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:54.745364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c4d01-12f2-4f9f-abac-49d40aa4c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:54.746302 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c4d01-12f2-4f9f-abac-49d40aa4c2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:54.746589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c4d01-12f2-4f9f-abac-49d40aa4c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:54.746984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c4d01-12f2-4f9f-abac-49d40aa4c2bd admin admin] PATH_INFO: `/v3/users/1a963a0f13ac4c1f9bb725bf0766d813` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:54.748227 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c4d01-12f2-4f9f-abac-49d40aa4c2bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a963a0f13ac4c1f9bb725bf0766d813)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:54.750580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c4d01-12f2-4f9f-abac-49d40aa4c2bd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:54.751900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce962942-10e1-4fa3-a508-36828d962e32 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:54.756909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5385-f919-471b-a360-99fc9374c787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:54.757607 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5385-f919-471b-a360-99fc9374c787 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:54.757893 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5385-f919-471b-a360-99fc9374c787 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:54.758199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5385-f919-471b-a360-99fc9374c787 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:54.758991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab5385-f919-471b-a360-99fc9374c787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:54:54.759292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab5385-f919-471b-a360-99fc9374c787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:54.760878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab5385-f919-471b-a360-99fc9374c787 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:54.772607 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1178/2368] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:54:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:54:54.776875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5385-f919-471b-a360-99fc9374c787 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:54.787938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5385-f919-471b-a360-99fc9374c787 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:54.792565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59b545-764d-4522-914f-45dfea7137d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:54.793208 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b545-764d-4522-914f-45dfea7137d0 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:54.793480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b545-764d-4522-914f-45dfea7137d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:54.793755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b545-764d-4522-914f-45dfea7137d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:54.794481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59b545-764d-4522-914f-45dfea7137d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:54.797587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59b545-764d-4522-914f-45dfea7137d0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:54.800256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a76c4d01-12f2-4f9f-abac-49d40aa4c2bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a963a0f13ac4c1f9bb725bf0766d813'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.812744 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a76c4d01-12f2-4f9f-abac-49d40aa4c2bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a963a0f13ac4c1f9bb725bf0766d813'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.813474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a76c4d01-12f2-4f9f-abac-49d40aa4c2bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a963a0f13ac4c1f9bb725bf0766d813'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.814170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a76c4d01-12f2-4f9f-abac-49d40aa4c2bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a963a0f13ac4c1f9bb725bf0766d813'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.821341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a76c4d01-12f2-4f9f-abac-49d40aa4c2bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a963a0f13ac4c1f9bb725bf0766d813'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:54.827668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1179/2369] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:54:54 2022] POST /identity/v3/projects => generated 394 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:54:54.829053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59b545-764d-4522-914f-45dfea7137d0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:54.830639 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7b59b545-764d-4522-914f-45dfea7137d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:54.834249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1191/2370] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:54:54 2022] DELETE /identity/v3/users/1a963a0f13ac4c1f9bb725bf0766d813 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:54.838360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341711-1a18-4ba9-8018-4a11cb95e977 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:54.838723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341711-1a18-4ba9-8018-4a11cb95e977 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:54.839037 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341711-1a18-4ba9-8018-4a11cb95e977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:54.856948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-e2341711-1a18-4ba9-8018-4a11cb95e977 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:54.858867 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e2341711-1a18-4ba9-8018-4a11cb95e977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:54.896391 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59b545-764d-4522-914f-45dfea7137d0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:54.917898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1192/2371] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:54:54.928242 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2341711-1a18-4ba9-8018-4a11cb95e977 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:54.929642 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e2341711-1a18-4ba9-8018-4a11cb95e977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:54.952655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab589de-7c2a-4ce5-9413-81447fec4580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:54.953299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab589de-7c2a-4ce5-9413-81447fec4580 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:54.953584 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab589de-7c2a-4ce5-9413-81447fec4580 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:54.953863 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab589de-7c2a-4ce5-9413-81447fec4580 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:54.954580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab589de-7c2a-4ce5-9413-81447fec4580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:54.956587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab589de-7c2a-4ce5-9413-81447fec4580 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:54.983964 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1180/2372] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:54:54 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:54:54.985293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab589de-7c2a-4ce5-9413-81447fec4580 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:54.993022 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2341711-1a18-4ba9-8018-4a11cb95e977 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:54.994831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab589de-7c2a-4ce5-9413-81447fec4580 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:54.996695 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868245c-f3e7-40a6-b18a-6e869615a998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:54.997386 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868245c-f3e7-40a6-b18a-6e869615a998 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:54.997668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868245c-f3e7-40a6-b18a-6e869615a998 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:54.997938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868245c-f3e7-40a6-b18a-6e869615a998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.000241 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15878c8-f027-440c-be41-42b18cdcf5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.000893 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15878c8-f027-440c-be41-42b18cdcf5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.001207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15878c8-f027-440c-be41-42b18cdcf5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.001489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15878c8-f027-440c-be41-42b18cdcf5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.002260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15878c8-f027-440c-be41-42b18cdcf5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.003923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15878c8-f027-440c-be41-42b18cdcf5d1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.007011 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868245c-f3e7-40a6-b18a-6e869615a998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.008468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868245c-f3e7-40a6-b18a-6e869615a998 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.013907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1181/2373] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:54 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:54:55.019226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15878c8-f027-440c-be41-42b18cdcf5d1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.019428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1193/2374] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:54:55.030407 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15878c8-f027-440c-be41-42b18cdcf5d1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.036408 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab512d5-1b24-4f87-929b-fa42291b8a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.037137 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab512d5-1b24-4f87-929b-fa42291b8a8d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.037452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab512d5-1b24-4f87-929b-fa42291b8a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.037749 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab512d5-1b24-4f87-929b-fa42291b8a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.038529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab512d5-1b24-4f87-929b-fa42291b8a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.040656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab512d5-1b24-4f87-929b-fa42291b8a8d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.054655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1182/2375] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:55 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:54:55.059784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868245c-f3e7-40a6-b18a-6e869615a998 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.070574 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868245c-f3e7-40a6-b18a-6e869615a998 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.075830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b4f2d-9141-487d-a9b1-b3755bc293fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.077275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b4f2d-9141-487d-a9b1-b3755bc293fd admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.078136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b4f2d-9141-487d-a9b1-b3755bc293fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.078423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b4f2d-9141-487d-a9b1-b3755bc293fd admin admin] PATH_INFO: `/v3/projects/779a6c558f224a56b20c13e0e9b29222/users/8a12927fa3964b32b4edc547765af865/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.094290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b4f2d-9141-487d-a9b1-b3755bc293fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=779a6c558f224a56b20c13e0e9b29222, user_id=8a12927fa3964b32b4edc547765af865, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.096970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b4f2d-9141-487d-a9b1-b3755bc293fd admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.110205 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1194/2376] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:55 2022] PUT /identity/v3/projects/779a6c558f224a56b20c13e0e9b29222/users/8a12927fa3964b32b4edc547765af865/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:55.120239 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0701-ccf7-4b2d-95d0-bc8d7bdf497f None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.120722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0701-ccf7-4b2d-95d0-bc8d7bdf497f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.120998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0701-ccf7-4b2d-95d0-bc8d7bdf497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.149157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-08bf0701-ccf7-4b2d-95d0-bc8d7bdf497f None None] MFA Rules not processed for user `8a12927fa3964b32b4edc547765af865`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:55.150396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-08bf0701-ccf7-4b2d-95d0-bc8d7bdf497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:55.220287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1183/2377] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:55.224747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b4f2d-9141-487d-a9b1-b3755bc293fd admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.286785 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b4f2d-9141-487d-a9b1-b3755bc293fd admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.288550 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf0701-ccf7-4b2d-95d0-bc8d7bdf497f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.290037 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-08bf0701-ccf7-4b2d-95d0-bc8d7bdf497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:55.292225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0048dc-f197-4fa7-8870-2f7bd1bb432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.292889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0048dc-f197-4fa7-8870-2f7bd1bb432b admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.293174 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0048dc-f197-4fa7-8870-2f7bd1bb432b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.293528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0048dc-f197-4fa7-8870-2f7bd1bb432b admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.294795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0048dc-f197-4fa7-8870-2f7bd1bb432b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.299445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0048dc-f197-4fa7-8870-2f7bd1bb432b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.306475 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf0701-ccf7-4b2d-95d0-bc8d7bdf497f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.312880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.313944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.314409 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.314929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] PATH_INFO: `/v3/projects/f3b257e02c5e4443a0e2df18b0e0bd2a` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.316942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b257e02c5e4443a0e2df18b0e0bd2a)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.319696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.334727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1195/2378] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:54:55 2022] POST /identity/v3/projects => generated 394 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:55.338776 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0048dc-f197-4fa7-8870-2f7bd1bb432b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.370688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b257e02c5e4443a0e2df18b0e0bd2a', 'request_id': 'req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:55.381579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b257e02c5e4443a0e2df18b0e0bd2a', 'request_id': 'req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:55.387952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b257e02c5e4443a0e2df18b0e0bd2a', 'request_id': 'req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:55.397742 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] The token cache is being invalidate because project f3b257e02c5e4443a0e2df18b0e0bd2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:54:55.398028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:55.398661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-25bdd4ff-67bf-4d3f-94dd-ebf12b21f15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:55.400238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1184/2379] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:54:55 2022] DELETE /identity/v3/projects/f3b257e02c5e4443a0e2df18b0e0bd2a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:54:55.402904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0048dc-f197-4fa7-8870-2f7bd1bb432b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.405870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d10b6-ae7e-4a6d-a908-4da16e831ea9 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.406145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d10b6-ae7e-4a6d-a908-4da16e831ea9 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.406418 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d10b6-ae7e-4a6d-a908-4da16e831ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.425377 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a67d10b6-ae7e-4a6d-a908-4da16e831ea9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:55.426623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a67d10b6-ae7e-4a6d-a908-4da16e831ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:55.458364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a7fb4-90c3-4aab-848a-c84e95cff504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.459156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a7fb4-90c3-4aab-848a-c84e95cff504 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.460046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a7fb4-90c3-4aab-848a-c84e95cff504 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.460046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a7fb4-90c3-4aab-848a-c84e95cff504 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.460522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a7fb4-90c3-4aab-848a-c84e95cff504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.463151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a7fb4-90c3-4aab-848a-c84e95cff504 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.488236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1196/2380] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:54:55 2022] POST /identity/v3/users => generated 304 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:54:55.488434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1185/2381] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:54:55.489413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a7fb4-90c3-4aab-848a-c84e95cff504 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.491054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-529a7fb4-90c3-4aab-848a-c84e95cff504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:55.495076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77cdbe-9259-478f-b358-39404843b1cb None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.495364 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77cdbe-9259-478f-b358-39404843b1cb None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.495637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77cdbe-9259-478f-b358-39404843b1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.504090 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a7fb4-90c3-4aab-848a-c84e95cff504 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.508709 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fc6f8-4cef-4bcd-b83b-c818fab0afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.509357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fc6f8-4cef-4bcd-b83b-c818fab0afa1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.509641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fc6f8-4cef-4bcd-b83b-c818fab0afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.509916 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fc6f8-4cef-4bcd-b83b-c818fab0afa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.510651 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fc6f8-4cef-4bcd-b83b-c818fab0afa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.512276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fc6f8-4cef-4bcd-b83b-c818fab0afa1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.512840 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-ee77cdbe-9259-478f-b358-39404843b1cb None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:55.514098 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ee77cdbe-9259-478f-b358-39404843b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:55.522140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1186/2382] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:54:55.526114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1197/2383] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:55 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:55.526260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77cdbe-9259-478f-b358-39404843b1cb None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.527142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fc6f8-4cef-4bcd-b83b-c818fab0afa1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.535593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77cdbe-9259-478f-b358-39404843b1cb None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.538960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fc6f8-4cef-4bcd-b83b-c818fab0afa1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.540156 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c8fe7-ef0a-45b2-86c4-550959fbd6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.540787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c8fe7-ef0a-45b2-86c4-550959fbd6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.541065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c8fe7-ef0a-45b2-86c4-550959fbd6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.541330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c8fe7-ef0a-45b2-86c4-550959fbd6b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.542049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c8fe7-ef0a-45b2-86c4-550959fbd6b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:54:55.542349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c8fe7-ef0a-45b2-86c4-550959fbd6b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.543968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c8fe7-ef0a-45b2-86c4-550959fbd6b8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.544082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7447df9-0709-4457-8f50-2762fe0f183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.544909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7447df9-0709-4457-8f50-2762fe0f183c admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.545190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7447df9-0709-4457-8f50-2762fe0f183c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.545522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7447df9-0709-4457-8f50-2762fe0f183c admin admin] PATH_INFO: `/v3/projects/aa7aba743f6c49f88bacbbb64ac3f57a/users/bc3767a4077046db83fde8d439ed8484/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.556318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1187/2384] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:54:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:54:55.560531 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c8fe7-ef0a-45b2-86c4-550959fbd6b8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.562524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7447df9-0709-4457-8f50-2762fe0f183c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7aba743f6c49f88bacbbb64ac3f57a, user_id=bc3767a4077046db83fde8d439ed8484, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.565235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7447df9-0709-4457-8f50-2762fe0f183c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.570935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c8fe7-ef0a-45b2-86c4-550959fbd6b8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.575596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5910ea-9bf3-40e8-b985-6d16fcc77cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.576215 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5910ea-9bf3-40e8-b985-6d16fcc77cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.576494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5910ea-9bf3-40e8-b985-6d16fcc77cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.577486 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5910ea-9bf3-40e8-b985-6d16fcc77cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.578453 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5910ea-9bf3-40e8-b985-6d16fcc77cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.578899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1198/2385] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:55 2022] PUT /identity/v3/projects/aa7aba743f6c49f88bacbbb64ac3f57a/users/bc3767a4077046db83fde8d439ed8484/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:55.581722 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5910ea-9bf3-40e8-b985-6d16fcc77cf7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.582657 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7447df9-0709-4457-8f50-2762fe0f183c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.608870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1188/2386] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:54:55 2022] POST /identity/v3/projects => generated 388 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:54:55.610009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5910ea-9bf3-40e8-b985-6d16fcc77cf7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.643812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7447df9-0709-4457-8f50-2762fe0f183c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.669768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5910ea-9bf3-40e8-b985-6d16fcc77cf7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.674572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd2134-0c99-4c9a-9d83-0744fff82bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.675260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd2134-0c99-4c9a-9d83-0744fff82bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.675536 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd2134-0c99-4c9a-9d83-0744fff82bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.675823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd2134-0c99-4c9a-9d83-0744fff82bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.676504 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd2134-0c99-4c9a-9d83-0744fff82bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.678427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd2134-0c99-4c9a-9d83-0744fff82bb1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.703055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1189/2387] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:54:55 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:55.704218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd2134-0c99-4c9a-9d83-0744fff82bb1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.705463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec583c-ee9d-4d86-957f-1d9afc2d50fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.706283 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec583c-ee9d-4d86-957f-1d9afc2d50fe admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.706492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec583c-ee9d-4d86-957f-1d9afc2d50fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.706717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec583c-ee9d-4d86-957f-1d9afc2d50fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.707512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec583c-ee9d-4d86-957f-1d9afc2d50fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.709100 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec583c-ee9d-4d86-957f-1d9afc2d50fe admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.714222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd2134-0c99-4c9a-9d83-0744fff82bb1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.719079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334b9ce-cb31-4a27-9a6a-d8e0f955cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.719937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334b9ce-cb31-4a27-9a6a-d8e0f955cb4e admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.720058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1199/2388] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:55 2022] GET /identity/v3/roles => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:54:55.720175 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334b9ce-cb31-4a27-9a6a-d8e0f955cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.720267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334b9ce-cb31-4a27-9a6a-d8e0f955cb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.720981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334b9ce-cb31-4a27-9a6a-d8e0f955cb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.722549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334b9ce-cb31-4a27-9a6a-d8e0f955cb4e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.727705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec583c-ee9d-4d86-957f-1d9afc2d50fe admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.735536 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1190/2389] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:55 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:54:55.738841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec583c-ee9d-4d86-957f-1d9afc2d50fe admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.739917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334b9ce-cb31-4a27-9a6a-d8e0f955cb4e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.743814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec188f-8b20-4af0-8719-4986a2a7d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.744695 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec188f-8b20-4af0-8719-4986a2a7d7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.744974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec188f-8b20-4af0-8719-4986a2a7d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.745246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec188f-8b20-4af0-8719-4986a2a7d7ae admin admin] PATH_INFO: `/v3/projects/aa7aba743f6c49f88bacbbb64ac3f57a/users/bc3767a4077046db83fde8d439ed8484/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.747317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec188f-8b20-4af0-8719-4986a2a7d7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7aba743f6c49f88bacbbb64ac3f57a, user_id=bc3767a4077046db83fde8d439ed8484, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.750310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334b9ce-cb31-4a27-9a6a-d8e0f955cb4e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.750466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec188f-8b20-4af0-8719-4986a2a7d7ae admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.755217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724c9e7-e2ef-4298-b2c6-7941f304604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.755867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724c9e7-e2ef-4298-b2c6-7941f304604d admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.756147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724c9e7-e2ef-4298-b2c6-7941f304604d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.756578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724c9e7-e2ef-4298-b2c6-7941f304604d admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.757347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724c9e7-e2ef-4298-b2c6-7941f304604d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.759025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724c9e7-e2ef-4298-b2c6-7941f304604d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.762063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1200/2390] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:55 2022] PUT /identity/v3/projects/aa7aba743f6c49f88bacbbb64ac3f57a/users/bc3767a4077046db83fde8d439ed8484/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:55.772761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1191/2391] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:55 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:55.773611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724c9e7-e2ef-4298-b2c6-7941f304604d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.773761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfcbcd-b96c-4523-853a-47405bed5832 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.774048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfcbcd-b96c-4523-853a-47405bed5832 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.774328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfcbcd-b96c-4523-853a-47405bed5832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.784167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724c9e7-e2ef-4298-b2c6-7941f304604d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.805436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a9dfcbcd-b96c-4523-853a-47405bed5832 None None] MFA Rules not processed for user `bc3767a4077046db83fde8d439ed8484`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:55.806909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a9dfcbcd-b96c-4523-853a-47405bed5832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:55.848975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28208d90-a6f8-4b72-a93a-e50a85feccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:55.849867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28208d90-a6f8-4b72-a93a-e50a85feccfd admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.850245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28208d90-a6f8-4b72-a93a-e50a85feccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.850412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28208d90-a6f8-4b72-a93a-e50a85feccfd admin admin] PATH_INFO: `/v3/projects/8b1345585538460a84b1822656be70ce/users/a4e4577e35c941b09a3630bfc9014d69/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.867494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28208d90-a6f8-4b72-a93a-e50a85feccfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1345585538460a84b1822656be70ce, user_id=a4e4577e35c941b09a3630bfc9014d69, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:55.870237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28208d90-a6f8-4b72-a93a-e50a85feccfd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:55.897978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1192/2392] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:55 2022] PUT /identity/v3/projects/8b1345585538460a84b1822656be70ce/users/a4e4577e35c941b09a3630bfc9014d69/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:55.899634 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689242fe-897c-4c95-8903-02f18b4a8974 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:55.899875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689242fe-897c-4c95-8903-02f18b4a8974 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:55.900236 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689242fe-897c-4c95-8903-02f18b4a8974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:55.905850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1201/2393] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:54:55.912519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfcbcd-b96c-4523-853a-47405bed5832 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:55.913951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a9dfcbcd-b96c-4523-853a-47405bed5832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:55.927736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-689242fe-897c-4c95-8903-02f18b4a8974 None None] MFA Rules not processed for user `a4e4577e35c941b09a3630bfc9014d69`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:55.928933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-689242fe-897c-4c95-8903-02f18b4a8974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:55.978968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfcbcd-b96c-4523-853a-47405bed5832 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:55.998720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1193/2394] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:56.005794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689242fe-897c-4c95-8903-02f18b4a8974 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:56.028386 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f3bb2-2ba2-40fc-a791-a18ca013e2ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:56.029031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f3bb2-2ba2-40fc-a791-a18ca013e2ab service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:56.029329 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f3bb2-2ba2-40fc-a791-a18ca013e2ab service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:56.029771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f3bb2-2ba2-40fc-a791-a18ca013e2ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:56.065859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689242fe-897c-4c95-8903-02f18b4a8974 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:56.070482 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3abc1-03c9-4243-b6e2-dc48e616b5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:56.071187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3abc1-03c9-4243-b6e2-dc48e616b5dc admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:56.071473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3abc1-03c9-4243-b6e2-dc48e616b5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:56.071747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3abc1-03c9-4243-b6e2-dc48e616b5dc admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:56.072452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3abc1-03c9-4243-b6e2-dc48e616b5dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:56.074348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3abc1-03c9-4243-b6e2-dc48e616b5dc admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:56.089112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f3bb2-2ba2-40fc-a791-a18ca013e2ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:56.090599 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f3bb2-2ba2-40fc-a791-a18ca013e2ab service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:56.100840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1202/2395] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:54:56.104735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f3bb2-2ba2-40fc-a791-a18ca013e2ab service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:56.105007 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1194/2396] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:54:56 2022] POST /identity/v3/projects => generated 388 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:54:56.114974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f3bb2-2ba2-40fc-a791-a18ca013e2ab service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:56.143145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3abc1-03c9-4243-b6e2-dc48e616b5dc admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:56.144885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ead3abc1-03c9-4243-b6e2-dc48e616b5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:56.175281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979862-2358-4f83-91e5-0d84059b906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:56.175978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979862-2358-4f83-91e5-0d84059b906c admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:56.176271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979862-2358-4f83-91e5-0d84059b906c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:56.176534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979862-2358-4f83-91e5-0d84059b906c admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:56.177236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6979862-2358-4f83-91e5-0d84059b906c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:56.179232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6979862-2358-4f83-91e5-0d84059b906c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:56.199194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1203/2397] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:54:56 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:54:56.203765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979862-2358-4f83-91e5-0d84059b906c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:56.204008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3abc1-03c9-4243-b6e2-dc48e616b5dc admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:56.207660 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af418e1-a992-4869-a6c6-e1fdeb8ed87e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:56.208300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af418e1-a992-4869-a6c6-e1fdeb8ed87e service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:56.208583 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af418e1-a992-4869-a6c6-e1fdeb8ed87e service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:56.208859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af418e1-a992-4869-a6c6-e1fdeb8ed87e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:56.210647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9af418e1-a992-4869-a6c6-e1fdeb8ed87e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:56.213649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979862-2358-4f83-91e5-0d84059b906c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:56.218362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c2d59-5b95-4b4c-bf14-37d705bfc82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:56.219126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c2d59-5b95-4b4c-bf14-37d705bfc82d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:56.219419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c2d59-5b95-4b4c-bf14-37d705bfc82d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:56.219698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c2d59-5b95-4b4c-bf14-37d705bfc82d admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:56.220431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c2d59-5b95-4b4c-bf14-37d705bfc82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:56.222028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c2d59-5b95-4b4c-bf14-37d705bfc82d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:56.235006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1204/2398] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:56 2022] GET /identity/v3/roles => generated 1427 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:54:56.236002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c2d59-5b95-4b4c-bf14-37d705bfc82d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:56.245249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c2d59-5b95-4b4c-bf14-37d705bfc82d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:56.250647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168550-1967-47db-b858-45e81040fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:56.251612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168550-1967-47db-b858-45e81040fa11 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:56.251896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168550-1967-47db-b858-45e81040fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:56.252173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168550-1967-47db-b858-45e81040fa11 admin admin] PATH_INFO: `/v3/projects/85d2d836886344e0b421bd37017a15e6/users/e80ea378ff6a4b7da7a4c9c8414e3467/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:56.267471 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6168550-1967-47db-b858-45e81040fa11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d2d836886344e0b421bd37017a15e6, user_id=e80ea378ff6a4b7da7a4c9c8414e3467, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:56.269875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af418e1-a992-4869-a6c6-e1fdeb8ed87e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:56.270144 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6168550-1967-47db-b858-45e81040fa11 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:56.271465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af418e1-a992-4869-a6c6-e1fdeb8ed87e service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:56.280524 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1195/2399] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:54:56.282905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1205/2400] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:56 2022] PUT /identity/v3/projects/85d2d836886344e0b421bd37017a15e6/users/e80ea378ff6a4b7da7a4c9c8414e3467/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:56.287727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af418e1-a992-4869-a6c6-e1fdeb8ed87e service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:56.298613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af418e1-a992-4869-a6c6-e1fdeb8ed87e service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:56.354319 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda3df6-ad47-40d1-92c9-baec65b5a0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:56.355012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda3df6-ad47-40d1-92c9-baec65b5a0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:56.355289 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda3df6-ad47-40d1-92c9-baec65b5a0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:56.355556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda3df6-ad47-40d1-92c9-baec65b5a0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:56.356288 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda3df6-ad47-40d1-92c9-baec65b5a0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:56.357911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda3df6-ad47-40d1-92c9-baec65b5a0d8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:56.367387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1196/2401] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:56 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:56.371771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168550-1967-47db-b858-45e81040fa11 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:56.382650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168550-1967-47db-b858-45e81040fa11 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:56.387460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde201a1-3dd1-48ce-800d-5d32bdda2ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:56.388324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde201a1-3dd1-48ce-800d-5d32bdda2ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:56.388603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde201a1-3dd1-48ce-800d-5d32bdda2ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:56.388871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde201a1-3dd1-48ce-800d-5d32bdda2ffb admin admin] PATH_INFO: `/v3/projects/85d2d836886344e0b421bd37017a15e6/users/e80ea378ff6a4b7da7a4c9c8414e3467/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:56.392118 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde201a1-3dd1-48ce-800d-5d32bdda2ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d2d836886344e0b421bd37017a15e6, user_id=e80ea378ff6a4b7da7a4c9c8414e3467, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:56.394823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde201a1-3dd1-48ce-800d-5d32bdda2ffb admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:56.406239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1206/2402] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:56 2022] PUT /identity/v3/projects/85d2d836886344e0b421bd37017a15e6/users/e80ea378ff6a4b7da7a4c9c8414e3467/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:56.416884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bd4cc-849e-44e1-a060-97bb61820c46 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:56.417182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bd4cc-849e-44e1-a060-97bb61820c46 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:56.417537 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bd4cc-849e-44e1-a060-97bb61820c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:56.446240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-e77bd4cc-849e-44e1-a060-97bb61820c46 None None] MFA Rules not processed for user `e80ea378ff6a4b7da7a4c9c8414e3467`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:56.447488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-e77bd4cc-849e-44e1-a060-97bb61820c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:56.527157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1197/2403] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:56.538145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde201a1-3dd1-48ce-800d-5d32bdda2ffb admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:56.597435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde201a1-3dd1-48ce-800d-5d32bdda2ffb admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:56.601942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd7d59-82cc-4568-9638-6a8bb6409439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:56.602583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd7d59-82cc-4568-9638-6a8bb6409439 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:56.602901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd7d59-82cc-4568-9638-6a8bb6409439 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:56.603180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd7d59-82cc-4568-9638-6a8bb6409439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:56.613558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd7d59-82cc-4568-9638-6a8bb6409439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:56.615013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd7d59-82cc-4568-9638-6a8bb6409439 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:56.624272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1207/2404] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:57.106934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bd4cc-849e-44e1-a060-97bb61820c46 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:57.168211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bd4cc-849e-44e1-a060-97bb61820c46 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:57.172776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:57.173574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:57.173857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:57.174132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] PATH_INFO: `/v3/users/a4e4577e35c941b09a3630bfc9014d69` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:57.175359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e4577e35c941b09a3630bfc9014d69)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:57.177485 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:57.221837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e4577e35c941b09a3630bfc9014d69'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.228331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e4577e35c941b09a3630bfc9014d69'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.235562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e4577e35c941b09a3630bfc9014d69'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.246839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e4577e35c941b09a3630bfc9014d69'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.247489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e4577e35c941b09a3630bfc9014d69'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.254201 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1198/2405] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:54:57 2022] DELETE /identity/v3/users/a4e4577e35c941b09a3630bfc9014d69 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:57.258907 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06f4b-6f62-4799-8482-928f0190c861 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:57.259202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06f4b-6f62-4799-8482-928f0190c861 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:57.259473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06f4b-6f62-4799-8482-928f0190c861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:57.277748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-43f06f4b-6f62-4799-8482-928f0190c861 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:57.278966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-43f06f4b-6f62-4799-8482-928f0190c861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:57.336108 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1208/2406] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:57.346308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:57.347713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:57.403107 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b719d9-104f-4676-9e2d-cc82dfadf0ac admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:57.407707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7aa7e-e071-4b64-bfd0-0dbe4e785194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:57.408342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7aa7e-e071-4b64-bfd0-0dbe4e785194 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:57.408621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7aa7e-e071-4b64-bfd0-0dbe4e785194 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:57.408897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7aa7e-e071-4b64-bfd0-0dbe4e785194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:57.417648 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7aa7e-e071-4b64-bfd0-0dbe4e785194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:57.419326 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7aa7e-e071-4b64-bfd0-0dbe4e785194 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:57.428862 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1199/2407] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:57.691245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f06f4b-6f62-4799-8482-928f0190c861 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:57.693226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-43f06f4b-6f62-4799-8482-928f0190c861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:57.705818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f06f4b-6f62-4799-8482-928f0190c861 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:57.710365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:57.711248 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:57.711526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:57.711922 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] PATH_INFO: `/v3/projects/8b1345585538460a84b1822656be70ce` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:57.713129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1345585538460a84b1822656be70ce)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:57.715015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:57.759525 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1345585538460a84b1822656be70ce', 'request_id': 'req-c9babff6-73f8-4be7-837f-3560388c3185'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.765484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1345585538460a84b1822656be70ce', 'request_id': 'req-c9babff6-73f8-4be7-837f-3560388c3185'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.772528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1345585538460a84b1822656be70ce', 'request_id': 'req-c9babff6-73f8-4be7-837f-3560388c3185'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.783270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] The token cache is being invalidate because project 8b1345585538460a84b1822656be70ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:54:57.783559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.784193 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.785725 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1209/2408] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:54:57 2022] DELETE /identity/v3/projects/8b1345585538460a84b1822656be70ce => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:54:57.789673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7aa7e-e071-4b64-bfd0-0dbe4e785194 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:57.799565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7aa7e-e071-4b64-bfd0-0dbe4e785194 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:57.854101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b96a9-ff12-4094-9a48-7004cea16a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:57.855066 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b96a9-ff12-4094-9a48-7004cea16a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:57.855372 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b96a9-ff12-4094-9a48-7004cea16a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:57.855673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b96a9-ff12-4094-9a48-7004cea16a9a admin admin] PATH_INFO: `/v3/users/e80ea378ff6a4b7da7a4c9c8414e3467` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:57.857057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b96a9-ff12-4094-9a48-7004cea16a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80ea378ff6a4b7da7a4c9c8414e3467)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:57.859242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b96a9-ff12-4094-9a48-7004cea16a9a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:57.905166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a13b96a9-ff12-4094-9a48-7004cea16a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80ea378ff6a4b7da7a4c9c8414e3467'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.912437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a13b96a9-ff12-4094-9a48-7004cea16a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80ea378ff6a4b7da7a4c9c8414e3467'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.919312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a13b96a9-ff12-4094-9a48-7004cea16a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80ea378ff6a4b7da7a4c9c8414e3467'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.931150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a13b96a9-ff12-4094-9a48-7004cea16a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80ea378ff6a4b7da7a4c9c8414e3467'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.931962 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-a13b96a9-ff12-4094-9a48-7004cea16a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80ea378ff6a4b7da7a4c9c8414e3467'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:57.938781 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1200/2409] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:54:57 2022] DELETE /identity/v3/users/e80ea378ff6a4b7da7a4c9c8414e3467 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:58.216506 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:58.218107 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:58.232154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9babff6-73f8-4be7-837f-3560388c3185 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:58.289780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:58.290629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:58.290945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:58.291219 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] PATH_INFO: `/v3/projects/85d2d836886344e0b421bd37017a15e6` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:58.292586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d2d836886344e0b421bd37017a15e6)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:58.294475 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:58.340179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d2d836886344e0b421bd37017a15e6', 'request_id': 'req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:58.345585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d2d836886344e0b421bd37017a15e6', 'request_id': 'req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:58.352557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d2d836886344e0b421bd37017a15e6', 'request_id': 'req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:58.363892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] The token cache is being invalidate because project 85d2d836886344e0b421bd37017a15e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:54:58.364172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:58.364817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-50900ca2-f9f4-42bd-9d57-aef8c3b0ca5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:54:58.366330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1210/2410] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:54:58 2022] DELETE /identity/v3/projects/85d2d836886344e0b421bd37017a15e6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:58.372018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e4d6c-ef93-4b99-bcf6-ae87df4fc335 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:58.372481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e4d6c-ef93-4b99-bcf6-ae87df4fc335 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:58.372574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e4d6c-ef93-4b99-bcf6-ae87df4fc335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:58.392770 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-335e4d6c-ef93-4b99-bcf6-ae87df4fc335 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:58.393949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-335e4d6c-ef93-4b99-bcf6-ae87df4fc335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:58.449593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1201/2411] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:58.458371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde1f0f-e2a3-4ebb-a635-26b990f89554 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:58.458659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde1f0f-e2a3-4ebb-a635-26b990f89554 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:58.458969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde1f0f-e2a3-4ebb-a635-26b990f89554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:58.478581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4dde1f0f-e2a3-4ebb-a635-26b990f89554 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:58.479736 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4dde1f0f-e2a3-4ebb-a635-26b990f89554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:58.488360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1211/2412] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:58.492479 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e4d6c-ef93-4b99-bcf6-ae87df4fc335 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:58.501902 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e4d6c-ef93-4b99-bcf6-ae87df4fc335 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:58.506369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2940116-7e81-491e-bb40-a268a5203052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:58.507046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2940116-7e81-491e-bb40-a268a5203052 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:58.507327 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2940116-7e81-491e-bb40-a268a5203052 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:58.507598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2940116-7e81-491e-bb40-a268a5203052 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:58.508323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2940116-7e81-491e-bb40-a268a5203052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:54:58.508625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2940116-7e81-491e-bb40-a268a5203052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:58.510207 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2940116-7e81-491e-bb40-a268a5203052 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:58.521302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1202/2413] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:54:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:54:58.525488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde1f0f-e2a3-4ebb-a635-26b990f89554 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:58.535333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde1f0f-e2a3-4ebb-a635-26b990f89554 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:58.540223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95f4c5-14cf-4056-a4e8-b20da5e17d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:58.540895 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95f4c5-14cf-4056-a4e8-b20da5e17d51 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:58.541180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95f4c5-14cf-4056-a4e8-b20da5e17d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:58.541458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95f4c5-14cf-4056-a4e8-b20da5e17d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:58.542170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95f4c5-14cf-4056-a4e8-b20da5e17d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:58.544129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95f4c5-14cf-4056-a4e8-b20da5e17d51 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:58.570301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1212/2414] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:54:58 2022] POST /identity/v3/projects => generated 372 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:54:58.574292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2940116-7e81-491e-bb40-a268a5203052 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:58.583938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2940116-7e81-491e-bb40-a268a5203052 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:58.638164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00372e2c-4cf6-4155-a851-940a58660360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:58.639100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00372e2c-4cf6-4155-a851-940a58660360 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:58.639258 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00372e2c-4cf6-4155-a851-940a58660360 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:58.639482 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00372e2c-4cf6-4155-a851-940a58660360 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:58.640179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00372e2c-4cf6-4155-a851-940a58660360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:58.642064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00372e2c-4cf6-4155-a851-940a58660360 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:58.663865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1203/2415] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:54:58 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:58.667714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95f4c5-14cf-4056-a4e8-b20da5e17d51 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:58.678653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95f4c5-14cf-4056-a4e8-b20da5e17d51 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:58.683561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b3515-0e90-44ba-987b-80d9b64de0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:58.684199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b3515-0e90-44ba-987b-80d9b64de0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:58.684476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b3515-0e90-44ba-987b-80d9b64de0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:58.684748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b3515-0e90-44ba-987b-80d9b64de0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:58.685477 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b3515-0e90-44ba-987b-80d9b64de0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:58.687356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b3515-0e90-44ba-987b-80d9b64de0b9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:58.697305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1213/2416] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:58 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:58.700963 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00372e2c-4cf6-4155-a851-940a58660360 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:58.710738 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00372e2c-4cf6-4155-a851-940a58660360 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:58.715411 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734203e-c8dc-4267-a91a-1f531609e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:58.716058 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734203e-c8dc-4267-a91a-1f531609e41f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:58.716341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734203e-c8dc-4267-a91a-1f531609e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:58.716617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734203e-c8dc-4267-a91a-1f531609e41f admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:58.717868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734203e-c8dc-4267-a91a-1f531609e41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:58.719489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734203e-c8dc-4267-a91a-1f531609e41f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:58.729341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1204/2417] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:58 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:58.733756 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b3515-0e90-44ba-987b-80d9b64de0b9 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:58.743275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b3515-0e90-44ba-987b-80d9b64de0b9 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:58.747802 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1804c-d4a0-48fd-b8af-def0f48255d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:58.748698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1804c-d4a0-48fd-b8af-def0f48255d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:58.749047 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1804c-d4a0-48fd-b8af-def0f48255d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:58.749322 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1804c-d4a0-48fd-b8af-def0f48255d4 admin admin] PATH_INFO: `/v3/projects/9aeaba301e2e494aa3002631926924a4/users/bdd9b6583db04739ad0548c3931899bb/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:58.764453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1804c-d4a0-48fd-b8af-def0f48255d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aeaba301e2e494aa3002631926924a4, user_id=bdd9b6583db04739ad0548c3931899bb, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:58.767077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1804c-d4a0-48fd-b8af-def0f48255d4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:58.779300 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1214/2418] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:58 2022] PUT /identity/v3/projects/9aeaba301e2e494aa3002631926924a4/users/bdd9b6583db04739ad0548c3931899bb/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:54:58.784709 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395912dd-f3c9-4619-a68a-2b668dba6369 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:58.784998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395912dd-f3c9-4619-a68a-2b668dba6369 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:58.785277 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395912dd-f3c9-4619-a68a-2b668dba6369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:58.802987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-395912dd-f3c9-4619-a68a-2b668dba6369 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:58.804174 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-395912dd-f3c9-4619-a68a-2b668dba6369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:58.861104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1205/2419] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:58.870850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1804c-d4a0-48fd-b8af-def0f48255d4 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:58.872530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-00a1804c-d4a0-48fd-b8af-def0f48255d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:58.928616 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1804c-d4a0-48fd-b8af-def0f48255d4 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:58.932633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac1b9f-c532-433b-a6c9-2052297b2404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:58.933275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac1b9f-c532-433b-a6c9-2052297b2404 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:58.933602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac1b9f-c532-433b-a6c9-2052297b2404 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:58.933873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac1b9f-c532-433b-a6c9-2052297b2404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:58.942784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac1b9f-c532-433b-a6c9-2052297b2404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:58.944211 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac1b9f-c532-433b-a6c9-2052297b2404 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:58.953905 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1215/2420] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:54:59.564781 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704b22-e424-4395-a344-22795cf47eb8 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:59.565269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704b22-e424-4395-a344-22795cf47eb8 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:59.565396 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704b22-e424-4395-a344-22795cf47eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:59.591323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-22704b22-e424-4395-a344-22795cf47eb8 None None] MFA Rules not processed for user `bdd9b6583db04739ad0548c3931899bb`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:54:59.592569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-22704b22-e424-4395-a344-22795cf47eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:54:59.655783 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1206/2421] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:54:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:54:59.660254 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac1b9f-c532-433b-a6c9-2052297b2404 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:59.669745 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac1b9f-c532-433b-a6c9-2052297b2404 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:59.675665 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be94a6-e677-4810-bcf8-f8b048f70e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:59.676309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be94a6-e677-4810-bcf8-f8b048f70e8f admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:59.676589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be94a6-e677-4810-bcf8-f8b048f70e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:59.676862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be94a6-e677-4810-bcf8-f8b048f70e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:59.677579 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be94a6-e677-4810-bcf8-f8b048f70e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:59.679495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be94a6-e677-4810-bcf8-f8b048f70e8f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:59.708379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1216/2422] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:54:59 2022] POST /identity/v3/projects => generated 374 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:59.712084 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22704b22-e424-4395-a344-22795cf47eb8 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:59.726069 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22704b22-e424-4395-a344-22795cf47eb8 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:59.784891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dae6c-0954-4ceb-bdb3-51af1901c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:59.785591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dae6c-0954-4ceb-bdb3-51af1901c0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:59.785874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dae6c-0954-4ceb-bdb3-51af1901c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:59.786152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dae6c-0954-4ceb-bdb3-51af1901c0a2 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:59.786885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dae6c-0954-4ceb-bdb3-51af1901c0a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:59.791344 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dae6c-0954-4ceb-bdb3-51af1901c0a2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:59.812555 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1207/2423] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:54:59 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:54:59.816522 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be94a6-e677-4810-bcf8-f8b048f70e8f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:59.827168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be94a6-e677-4810-bcf8-f8b048f70e8f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:59.832196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486467a-6385-48ba-8625-cb3b1ca78a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:59.832842 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486467a-6385-48ba-8625-cb3b1ca78a9a admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:59.833124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486467a-6385-48ba-8625-cb3b1ca78a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:59.833397 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486467a-6385-48ba-8625-cb3b1ca78a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:59.834127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486467a-6385-48ba-8625-cb3b1ca78a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:59.835809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486467a-6385-48ba-8625-cb3b1ca78a9a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:59.846619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1217/2424] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:59 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:59.850465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dae6c-0954-4ceb-bdb3-51af1901c0a2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:59.860909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dae6c-0954-4ceb-bdb3-51af1901c0a2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:59.865483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760c054-8fe1-48ef-a092-b6964c91a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:59.866343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760c054-8fe1-48ef-a092-b6964c91a822 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:59.866623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760c054-8fe1-48ef-a092-b6964c91a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:59.867061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760c054-8fe1-48ef-a092-b6964c91a822 admin admin] PATH_INFO: `/v3/projects/e97490f295204ca1a6d331c7ee0c9b66/users/89cc490b489d4d2a972fcb2595c8f063/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:59.882011 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760c054-8fe1-48ef-a092-b6964c91a822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97490f295204ca1a6d331c7ee0c9b66, user_id=89cc490b489d4d2a972fcb2595c8f063, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:59.884678 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760c054-8fe1-48ef-a092-b6964c91a822 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:59.898869 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1208/2425] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:59 2022] PUT /identity/v3/projects/e97490f295204ca1a6d331c7ee0c9b66/users/89cc490b489d4d2a972fcb2595c8f063/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:54:59.902499 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486467a-6385-48ba-8625-cb3b1ca78a9a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:59.912632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486467a-6385-48ba-8625-cb3b1ca78a9a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:54:59.967918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894af394-248e-498f-82a3-4342e6e103f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:54:59.968601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af394-248e-498f-82a3-4342e6e103f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:54:59.968885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af394-248e-498f-82a3-4342e6e103f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:54:59.969150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af394-248e-498f-82a3-4342e6e103f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:54:59.969874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894af394-248e-498f-82a3-4342e6e103f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:54:59.971461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894af394-248e-498f-82a3-4342e6e103f3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:54:59.980927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1218/2426] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:54:59 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:54:59.986674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760c054-8fe1-48ef-a092-b6964c91a822 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:54:59.998808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760c054-8fe1-48ef-a092-b6964c91a822 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:00.008492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e18a62-19b8-4624-8452-c1a4f011c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:00.009693 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e18a62-19b8-4624-8452-c1a4f011c894 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:00.010038 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e18a62-19b8-4624-8452-c1a4f011c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:00.010386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e18a62-19b8-4624-8452-c1a4f011c894 admin admin] PATH_INFO: `/v3/projects/e97490f295204ca1a6d331c7ee0c9b66/users/89cc490b489d4d2a972fcb2595c8f063/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:00.013533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e18a62-19b8-4624-8452-c1a4f011c894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97490f295204ca1a6d331c7ee0c9b66, user_id=89cc490b489d4d2a972fcb2595c8f063, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:00.018557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e18a62-19b8-4624-8452-c1a4f011c894 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:00.038880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1209/2427] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:54:59 2022] PUT /identity/v3/projects/e97490f295204ca1a6d331c7ee0c9b66/users/89cc490b489d4d2a972fcb2595c8f063/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:55:00.719501 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9688-27ad-49c4-be90-93388475b4d1 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:00.720179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9688-27ad-49c4-be90-93388475b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:00.720179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9688-27ad-49c4-be90-93388475b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:00.749636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-360b9688-27ad-49c4-be90-93388475b4d1 None None] MFA Rules not processed for user `89cc490b489d4d2a972fcb2595c8f063`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:00.750888 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-360b9688-27ad-49c4-be90-93388475b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:00.824640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1219/2428] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:00.835002 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e18a62-19b8-4624-8452-c1a4f011c894 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:00.836728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-87e18a62-19b8-4624-8452-c1a4f011c894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:00.893791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e18a62-19b8-4624-8452-c1a4f011c894 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:00.897382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5512943-959c-4499-bb1b-67728754e8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:00.898023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5512943-959c-4499-bb1b-67728754e8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:00.898299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5512943-959c-4499-bb1b-67728754e8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:00.898570 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5512943-959c-4499-bb1b-67728754e8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:00.955415 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5512943-959c-4499-bb1b-67728754e8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:00.956837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5512943-959c-4499-bb1b-67728754e8a4 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:00.965430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1210/2429] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:01.653781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9688-27ad-49c4-be90-93388475b4d1 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:01.655449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-360b9688-27ad-49c4-be90-93388475b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:01.727365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9688-27ad-49c4-be90-93388475b4d1 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:01.733259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:01.734115 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:01.734391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:01.734659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] PATH_INFO: `/v3/users/8a12927fa3964b32b4edc547765af865` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:01.735927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a12927fa3964b32b4edc547765af865)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:01.737856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:01.784879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a12927fa3964b32b4edc547765af865'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:01.796866 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a12927fa3964b32b4edc547765af865'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:01.797541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a12927fa3964b32b4edc547765af865'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:01.798174 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a12927fa3964b32b4edc547765af865'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:01.806246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a12927fa3964b32b4edc547765af865'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:01.820075 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1220/2430] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:55:01 2022] DELETE /identity/v3/users/8a12927fa3964b32b4edc547765af865 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:01.824595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f3ef-9350-4211-b497-20609d213d1f None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:01.824885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f3ef-9350-4211-b497-20609d213d1f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:01.825168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f3ef-9350-4211-b497-20609d213d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:01.842740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-2205f3ef-9350-4211-b497-20609d213d1f None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:01.843944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-2205f3ef-9350-4211-b497-20609d213d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:01.902622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1211/2431] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:01.912177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:01.913612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:01.969947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b9f6-5194-47d4-a83b-688acaef42db admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:01.973636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0a8da-9d5a-49e1-917d-ff3d8628f982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:01.974266 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0a8da-9d5a-49e1-917d-ff3d8628f982 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:01.974551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0a8da-9d5a-49e1-917d-ff3d8628f982 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:01.974863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0a8da-9d5a-49e1-917d-ff3d8628f982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:01.984270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0a8da-9d5a-49e1-917d-ff3d8628f982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:01.985699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0a8da-9d5a-49e1-917d-ff3d8628f982 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:01.994881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1221/2432] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:02.270237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205f3ef-9350-4211-b497-20609d213d1f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:02.272436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-2205f3ef-9350-4211-b497-20609d213d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:02.287634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0a8da-9d5a-49e1-917d-ff3d8628f982 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:02.289202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b6c0a8da-9d5a-49e1-917d-ff3d8628f982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:02.291067 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205f3ef-9350-4211-b497-20609d213d1f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:02.299529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:02.300529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:02.301517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:02.301517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] PATH_INFO: `/v3/projects/779a6c558f224a56b20c13e0e9b29222` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:02.303208 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=779a6c558f224a56b20c13e0e9b29222)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:02.305794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:02.366403 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779a6c558f224a56b20c13e0e9b29222', 'request_id': 'req-8ce31d5d-5398-4e49-b6d4-b048165d7799'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:02.368323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0a8da-9d5a-49e1-917d-ff3d8628f982 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:02.378083 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779a6c558f224a56b20c13e0e9b29222', 'request_id': 'req-8ce31d5d-5398-4e49-b6d4-b048165d7799'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:02.384696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779a6c558f224a56b20c13e0e9b29222', 'request_id': 'req-8ce31d5d-5398-4e49-b6d4-b048165d7799'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:02.395975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] The token cache is being invalidate because project 779a6c558f224a56b20c13e0e9b29222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:55:02.396269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:02.396911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:02.398583 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1212/2433] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:55:02 2022] DELETE /identity/v3/projects/779a6c558f224a56b20c13e0e9b29222 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:02.402363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:02.403765 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:02.432517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942057-a663-4371-a72f-546db4194efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:02.433549 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942057-a663-4371-a72f-546db4194efd service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:02.434113 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942057-a663-4371-a72f-546db4194efd service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:02.434664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942057-a663-4371-a72f-546db4194efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:02.437857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-91942057-a663-4371-a72f-546db4194efd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:02.479624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce31d5d-5398-4e49-b6d4-b048165d7799 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:02.485189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412be9e-cc16-493d-b4a7-dbaecbb65a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:02.486049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412be9e-cc16-493d-b4a7-dbaecbb65a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:02.486325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412be9e-cc16-493d-b4a7-dbaecbb65a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:02.486591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412be9e-cc16-493d-b4a7-dbaecbb65a13 admin admin] PATH_INFO: `/v3/users/bc3767a4077046db83fde8d439ed8484` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:02.487859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412be9e-cc16-493d-b4a7-dbaecbb65a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3767a4077046db83fde8d439ed8484)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:02.489758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412be9e-cc16-493d-b4a7-dbaecbb65a13 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:02.502247 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91942057-a663-4371-a72f-546db4194efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:02.503766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91942057-a663-4371-a72f-546db4194efd service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:02.513433 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1222/2434] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:02.535478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b412be9e-cc16-493d-b4a7-dbaecbb65a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3767a4077046db83fde8d439ed8484'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:02.543092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b412be9e-cc16-493d-b4a7-dbaecbb65a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3767a4077046db83fde8d439ed8484'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:02.550481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b412be9e-cc16-493d-b4a7-dbaecbb65a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3767a4077046db83fde8d439ed8484'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:02.563788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b412be9e-cc16-493d-b4a7-dbaecbb65a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3767a4077046db83fde8d439ed8484'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:02.564499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b412be9e-cc16-493d-b4a7-dbaecbb65a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3767a4077046db83fde8d439ed8484'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:02.570564 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1213/2435] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:55:02 2022] DELETE /identity/v3/users/bc3767a4077046db83fde8d439ed8484 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:02.902680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942057-a663-4371-a72f-546db4194efd service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:02.919390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942057-a663-4371-a72f-546db4194efd service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.010135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.011265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.011809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.012146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] PATH_INFO: `/v3/projects/aa7aba743f6c49f88bacbbb64ac3f57a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.013714 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7aba743f6c49f88bacbbb64ac3f57a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:03.016054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:03.078526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7aba743f6c49f88bacbbb64ac3f57a', 'request_id': 'req-f8f414de-3218-4f00-a52a-71c01c8aec49'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:03.084438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7aba743f6c49f88bacbbb64ac3f57a', 'request_id': 'req-f8f414de-3218-4f00-a52a-71c01c8aec49'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:03.093070 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7aba743f6c49f88bacbbb64ac3f57a', 'request_id': 'req-f8f414de-3218-4f00-a52a-71c01c8aec49'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:03.106013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] The token cache is being invalidate because project aa7aba743f6c49f88bacbbb64ac3f57a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:55:03.106387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:03.107129 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-f8f414de-3218-4f00-a52a-71c01c8aec49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:03.109484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1223/2436] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:55:02 2022] DELETE /identity/v3/projects/aa7aba743f6c49f88bacbbb64ac3f57a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:03.115049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4fdfe-7aff-4a7d-b0af-1fd1456bc93a None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.115541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4fdfe-7aff-4a7d-b0af-1fd1456bc93a None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.115635 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4fdfe-7aff-4a7d-b0af-1fd1456bc93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.133451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-61f4fdfe-7aff-4a7d-b0af-1fd1456bc93a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:03.134642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-61f4fdfe-7aff-4a7d-b0af-1fd1456bc93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:03.195829 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1214/2437] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:03.204692 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939b89-e4dd-4e55-a47a-b9b24725b2d0 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.204977 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939b89-e4dd-4e55-a47a-b9b24725b2d0 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.205252 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939b89-e4dd-4e55-a47a-b9b24725b2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.223512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5a939b89-e4dd-4e55-a47a-b9b24725b2d0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:03.224732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5a939b89-e4dd-4e55-a47a-b9b24725b2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:03.232981 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1224/2438] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:03.237109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4fdfe-7aff-4a7d-b0af-1fd1456bc93a None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:03.246878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4fdfe-7aff-4a7d-b0af-1fd1456bc93a None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.252071 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72121072-9819-4f24-a74b-4673c90ed233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.252770 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72121072-9819-4f24-a74b-4673c90ed233 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.253160 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72121072-9819-4f24-a74b-4673c90ed233 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.253434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72121072-9819-4f24-a74b-4673c90ed233 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.254164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72121072-9819-4f24-a74b-4673c90ed233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:55:03.254468 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72121072-9819-4f24-a74b-4673c90ed233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:03.256096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72121072-9819-4f24-a74b-4673c90ed233 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:03.267828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1215/2439] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:55:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:55:03.272294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a939b89-e4dd-4e55-a47a-b9b24725b2d0 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:03.282545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a939b89-e4dd-4e55-a47a-b9b24725b2d0 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.287253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc38bd-718b-417c-b88b-47dad985bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.287896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc38bd-718b-417c-b88b-47dad985bb79 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.288182 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc38bd-718b-417c-b88b-47dad985bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.288458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc38bd-718b-417c-b88b-47dad985bb79 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.289172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc38bd-718b-417c-b88b-47dad985bb79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:03.291079 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc38bd-718b-417c-b88b-47dad985bb79 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:03.320099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1225/2440] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:55:03 2022] POST /identity/v3/projects => generated 384 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:55:03.321467 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72121072-9819-4f24-a74b-4673c90ed233 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:03.331991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72121072-9819-4f24-a74b-4673c90ed233 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.389764 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946e4ab-ba75-440b-bcee-82ad2b27ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.390438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e4ab-ba75-440b-bcee-82ad2b27ebc6 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.390724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e4ab-ba75-440b-bcee-82ad2b27ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.391038 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e4ab-ba75-440b-bcee-82ad2b27ebc6 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.391978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946e4ab-ba75-440b-bcee-82ad2b27ebc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:03.394099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946e4ab-ba75-440b-bcee-82ad2b27ebc6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:03.414142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1216/2441] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:55:03 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:55:03.418140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc38bd-718b-417c-b88b-47dad985bb79 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:03.428429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc38bd-718b-417c-b88b-47dad985bb79 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.433110 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1539-75ab-4f38-8ac7-700c2ef99c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.433747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1539-75ab-4f38-8ac7-700c2ef99c83 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.434034 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1539-75ab-4f38-8ac7-700c2ef99c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.434297 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1539-75ab-4f38-8ac7-700c2ef99c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.435072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d1539-75ab-4f38-8ac7-700c2ef99c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:03.436932 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d1539-75ab-4f38-8ac7-700c2ef99c83 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:03.446871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1226/2442] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:03 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:55:03.450645 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946e4ab-ba75-440b-bcee-82ad2b27ebc6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:03.461042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946e4ab-ba75-440b-bcee-82ad2b27ebc6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.468576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11babe-235d-42bd-b119-75fd4a054c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.469476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11babe-235d-42bd-b119-75fd4a054c6b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.469762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11babe-235d-42bd-b119-75fd4a054c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.470040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11babe-235d-42bd-b119-75fd4a054c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.470819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11babe-235d-42bd-b119-75fd4a054c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:03.472419 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11babe-235d-42bd-b119-75fd4a054c6b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:03.482213 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1217/2443] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:03 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:55:03.488738 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1539-75ab-4f38-8ac7-700c2ef99c83 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:03.499028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1539-75ab-4f38-8ac7-700c2ef99c83 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.503564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a795abd-48e7-4800-9bad-642c205a297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.504418 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795abd-48e7-4800-9bad-642c205a297a admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.504700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795abd-48e7-4800-9bad-642c205a297a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.504975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795abd-48e7-4800-9bad-642c205a297a admin admin] PATH_INFO: `/v3/projects/974326411636446bbe6368a4eb959b75/users/f7fa5c84c32845fdb6282757be2c5326/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.518960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a795abd-48e7-4800-9bad-642c205a297a admin admin] RBAC: Authorizing `identity:create_grant(project_id=974326411636446bbe6368a4eb959b75, user_id=f7fa5c84c32845fdb6282757be2c5326, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:03.521576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a795abd-48e7-4800-9bad-642c205a297a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:03.533696 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1227/2444] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:03 2022] PUT /identity/v3/projects/974326411636446bbe6368a4eb959b75/users/f7fa5c84c32845fdb6282757be2c5326/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:03.543762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c2f9-8a13-419a-b735-2e319c965948 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.544054 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c2f9-8a13-419a-b735-2e319c965948 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.544383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c2f9-8a13-419a-b735-2e319c965948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.572452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-07c2c2f9-8a13-419a-b735-2e319c965948 None None] MFA Rules not processed for user `f7fa5c84c32845fdb6282757be2c5326`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:03.573770 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-07c2c2f9-8a13-419a-b735-2e319c965948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:03.634778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1218/2445] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:03.639808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a795abd-48e7-4800-9bad-642c205a297a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:03.700127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a795abd-48e7-4800-9bad-642c205a297a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.705003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c8e32-d6ba-4526-8d92-24c07f23ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.705671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c8e32-d6ba-4526-8d92-24c07f23ae11 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.705952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c8e32-d6ba-4526-8d92-24c07f23ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.706228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c8e32-d6ba-4526-8d92-24c07f23ae11 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.706947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c8e32-d6ba-4526-8d92-24c07f23ae11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:03.708830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c8e32-d6ba-4526-8d92-24c07f23ae11 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:03.736136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1228/2446] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:55:03 2022] POST /identity/v3/projects => generated 386 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:55:03.740667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2c2f9-8a13-419a-b735-2e319c965948 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:03.751923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2c2f9-8a13-419a-b735-2e319c965948 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.807800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed600433-f538-41c8-a1e8-51ea82d526f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.808521 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed600433-f538-41c8-a1e8-51ea82d526f5 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.808933 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed600433-f538-41c8-a1e8-51ea82d526f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.809218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed600433-f538-41c8-a1e8-51ea82d526f5 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.809955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed600433-f538-41c8-a1e8-51ea82d526f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:03.812436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed600433-f538-41c8-a1e8-51ea82d526f5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:03.833369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1219/2447] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:55:03 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:55:03.837684 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c8e32-d6ba-4526-8d92-24c07f23ae11 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:03.847850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c8e32-d6ba-4526-8d92-24c07f23ae11 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.852554 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac236448-e428-4dfb-a7f5-7e57c004486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.853209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac236448-e428-4dfb-a7f5-7e57c004486d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.853519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac236448-e428-4dfb-a7f5-7e57c004486d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.853798 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac236448-e428-4dfb-a7f5-7e57c004486d admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.854536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac236448-e428-4dfb-a7f5-7e57c004486d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:03.856147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac236448-e428-4dfb-a7f5-7e57c004486d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:03.866780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1229/2448] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:03 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:55:03.871014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed600433-f538-41c8-a1e8-51ea82d526f5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:03.881975 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed600433-f538-41c8-a1e8-51ea82d526f5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.886905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef62e1c-82d8-41f4-839c-3065b1bfa8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.887854 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef62e1c-82d8-41f4-839c-3065b1bfa8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.888196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef62e1c-82d8-41f4-839c-3065b1bfa8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.889177 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef62e1c-82d8-41f4-839c-3065b1bfa8cf admin admin] PATH_INFO: `/v3/projects/922e97eb400c4a68a568130e6d1db418/users/7852a5fe94ea492b9b5cae4265321830/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:03.904753 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef62e1c-82d8-41f4-839c-3065b1bfa8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=922e97eb400c4a68a568130e6d1db418, user_id=7852a5fe94ea492b9b5cae4265321830, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:03.907530 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef62e1c-82d8-41f4-839c-3065b1bfa8cf admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:03.921219 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1220/2449] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:03 2022] PUT /identity/v3/projects/922e97eb400c4a68a568130e6d1db418/users/7852a5fe94ea492b9b5cae4265321830/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:55:03.925382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac236448-e428-4dfb-a7f5-7e57c004486d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:03.937710 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac236448-e428-4dfb-a7f5-7e57c004486d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:03.996569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fe3e8-c9ac-4960-a973-d7d878093e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:03.997485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fe3e8-c9ac-4960-a973-d7d878093e0f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:03.998521 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fe3e8-c9ac-4960-a973-d7d878093e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:03.999436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fe3e8-c9ac-4960-a973-d7d878093e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:04.000490 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fe3e8-c9ac-4960-a973-d7d878093e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:04.003054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fe3e8-c9ac-4960-a973-d7d878093e0f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:04.015900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1230/2450] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:03 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:55:04.019874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef62e1c-82d8-41f4-839c-3065b1bfa8cf admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:04.031238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef62e1c-82d8-41f4-839c-3065b1bfa8cf admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:04.045260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3ea88-1a38-4f1a-aba6-cdc290a12e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:04.047166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3ea88-1a38-4f1a-aba6-cdc290a12e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:04.048464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3ea88-1a38-4f1a-aba6-cdc290a12e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:04.048594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3ea88-1a38-4f1a-aba6-cdc290a12e62 admin admin] PATH_INFO: `/v3/projects/922e97eb400c4a68a568130e6d1db418/users/7852a5fe94ea492b9b5cae4265321830/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:04.052999 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3ea88-1a38-4f1a-aba6-cdc290a12e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922e97eb400c4a68a568130e6d1db418, user_id=7852a5fe94ea492b9b5cae4265321830, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:04.059073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3ea88-1a38-4f1a-aba6-cdc290a12e62 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:04.080806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1221/2451] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:04 2022] PUT /identity/v3/projects/922e97eb400c4a68a568130e6d1db418/users/7852a5fe94ea492b9b5cae4265321830/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:04.091787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d57d0-4a11-4ad4-8962-3d596a7d43e7 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:04.092198 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d57d0-4a11-4ad4-8962-3d596a7d43e7 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:04.092667 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d57d0-4a11-4ad4-8962-3d596a7d43e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:04.142176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ce5d57d0-4a11-4ad4-8962-3d596a7d43e7 None None] MFA Rules not processed for user `7852a5fe94ea492b9b5cae4265321830`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:04.143624 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ce5d57d0-4a11-4ad4-8962-3d596a7d43e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:04.247926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1231/2452] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:04.258174 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3ea88-1a38-4f1a-aba6-cdc290a12e62 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:04.259897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d2b3ea88-1a38-4f1a-aba6-cdc290a12e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:04.323606 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3ea88-1a38-4f1a-aba6-cdc290a12e62 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:04.328153 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bc70a-5164-4a8a-8d5d-6a75374f9f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:04.328889 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bc70a-5164-4a8a-8d5d-6a75374f9f51 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:04.329244 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bc70a-5164-4a8a-8d5d-6a75374f9f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:04.329597 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bc70a-5164-4a8a-8d5d-6a75374f9f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:04.387612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bc70a-5164-4a8a-8d5d-6a75374f9f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:04.390325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bc70a-5164-4a8a-8d5d-6a75374f9f51 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:04.399970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1222/2453] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:11.695589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d57d0-4a11-4ad4-8962-3d596a7d43e7 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:11.697117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ce5d57d0-4a11-4ad4-8962-3d596a7d43e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:11.709398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d57d0-4a11-4ad4-8962-3d596a7d43e7 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:11.712944 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c0613-cb1c-4e52-bd4f-3b13bdd37560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:11.713564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0613-cb1c-4e52-bd4f-3b13bdd37560 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:11.713846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0613-cb1c-4e52-bd4f-3b13bdd37560 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:11.714119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0613-cb1c-4e52-bd4f-3b13bdd37560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:11.723418 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c0613-cb1c-4e52-bd4f-3b13bdd37560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:11.724925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c0613-cb1c-4e52-bd4f-3b13bdd37560 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:11.734398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1232/2454] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:16.555012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bc70a-5164-4a8a-8d5d-6a75374f9f51 service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:16.616914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bc70a-5164-4a8a-8d5d-6a75374f9f51 service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:16.621514 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:16.622368 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:16.622644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:16.622946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] PATH_INFO: `/v3/users/f7fa5c84c32845fdb6282757be2c5326` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:16.624132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7fa5c84c32845fdb6282757be2c5326)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:16.626109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:16.674911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7fa5c84c32845fdb6282757be2c5326'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:16.683784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7fa5c84c32845fdb6282757be2c5326'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:16.692370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7fa5c84c32845fdb6282757be2c5326'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:16.704683 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7fa5c84c32845fdb6282757be2c5326'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:16.705433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7fa5c84c32845fdb6282757be2c5326'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:16.712508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1223/2455] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:55:16 2022] DELETE /identity/v3/users/f7fa5c84c32845fdb6282757be2c5326 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:16.717052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb916e5-9680-4d7d-91dc-ed89e4fdc6f8 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:16.717535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb916e5-9680-4d7d-91dc-ed89e4fdc6f8 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:16.717641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb916e5-9680-4d7d-91dc-ed89e4fdc6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:16.736819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-beb916e5-9680-4d7d-91dc-ed89e4fdc6f8 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:16.738039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-beb916e5-9680-4d7d-91dc-ed89e4fdc6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:16.807457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1233/2456] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:16.814310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:16.815823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:16.879711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78485a-4d6d-4e81-b402-e6537985afab admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:16.884557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7ee03-2094-4a7d-af7c-eb8efa0c84ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:16.885488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7ee03-2094-4a7d-af7c-eb8efa0c84ef service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:16.885774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7ee03-2094-4a7d-af7c-eb8efa0c84ef service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:16.886056 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7ee03-2094-4a7d-af7c-eb8efa0c84ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:16.896845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7ee03-2094-4a7d-af7c-eb8efa0c84ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:16.898985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7ee03-2094-4a7d-af7c-eb8efa0c84ef service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:16.909334 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1224/2457] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:55:17.207525 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb916e5-9680-4d7d-91dc-ed89e4fdc6f8 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:17.209584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-beb916e5-9680-4d7d-91dc-ed89e4fdc6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:17.246543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb916e5-9680-4d7d-91dc-ed89e4fdc6f8 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:17.254666 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:17.256131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:17.256718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:17.257294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] PATH_INFO: `/v3/projects/974326411636446bbe6368a4eb959b75` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:17.259720 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=974326411636446bbe6368a4eb959b75)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:17.263537 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:17.339818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '974326411636446bbe6368a4eb959b75', 'request_id': 'req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.346543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '974326411636446bbe6368a4eb959b75', 'request_id': 'req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.355538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '974326411636446bbe6368a4eb959b75', 'request_id': 'req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.369552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] The token cache is being invalidate because project 974326411636446bbe6368a4eb959b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:55:17.369946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.370678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.372436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1234/2458] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:55:17 2022] DELETE /identity/v3/projects/974326411636446bbe6368a4eb959b75 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:55:17.378086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7ee03-2094-4a7d-af7c-eb8efa0c84ef service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:17.395719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7ee03-2094-4a7d-af7c-eb8efa0c84ef service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:17.470282 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:17.471336 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:17.471620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:17.472008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] PATH_INFO: `/v3/users/7852a5fe94ea492b9b5cae4265321830` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:17.473483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7852a5fe94ea492b9b5cae4265321830)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:17.475439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:17.521191 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7852a5fe94ea492b9b5cae4265321830'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.529427 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7852a5fe94ea492b9b5cae4265321830'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.537529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7852a5fe94ea492b9b5cae4265321830'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.548678 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7852a5fe94ea492b9b5cae4265321830'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.549361 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7852a5fe94ea492b9b5cae4265321830'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.555570 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1225/2459] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:55:17 2022] DELETE /identity/v3/users/7852a5fe94ea492b9b5cae4265321830 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:17.718009 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:17.720576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:17.734326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcd58c-c1ac-4f15-89d7-0d0f24e2a6ae admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:17.791422 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40888f14-4cfb-4147-9168-0a611eb33536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:17.792306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40888f14-4cfb-4147-9168-0a611eb33536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:17.792534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40888f14-4cfb-4147-9168-0a611eb33536 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:17.792811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40888f14-4cfb-4147-9168-0a611eb33536 admin admin] PATH_INFO: `/v3/users/bdd9b6583db04739ad0548c3931899bb` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:17.794025 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40888f14-4cfb-4147-9168-0a611eb33536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd9b6583db04739ad0548c3931899bb)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:17.795952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40888f14-4cfb-4147-9168-0a611eb33536 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:17.855189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-40888f14-4cfb-4147-9168-0a611eb33536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd9b6583db04739ad0548c3931899bb'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.869200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-40888f14-4cfb-4147-9168-0a611eb33536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd9b6583db04739ad0548c3931899bb'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.870796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-40888f14-4cfb-4147-9168-0a611eb33536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd9b6583db04739ad0548c3931899bb'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.871476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-40888f14-4cfb-4147-9168-0a611eb33536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd9b6583db04739ad0548c3931899bb'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.879841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-40888f14-4cfb-4147-9168-0a611eb33536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd9b6583db04739ad0548c3931899bb'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:17.894167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1235/2460] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:55:17 2022] DELETE /identity/v3/users/bdd9b6583db04739ad0548c3931899bb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:17.952827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:17.954871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:17.968525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170270c1-0009-4565-a199-0ecf51755569 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:18.030255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:18.031172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.031995 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.032268 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] PATH_INFO: `/v3/projects/922e97eb400c4a68a568130e6d1db418` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.033498 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922e97eb400c4a68a568130e6d1db418)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:18.036134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:18.087299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922e97eb400c4a68a568130e6d1db418', 'request_id': 'req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.098496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922e97eb400c4a68a568130e6d1db418', 'request_id': 'req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.106414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922e97eb400c4a68a568130e6d1db418', 'request_id': 'req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.119769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] The token cache is being invalidate because project 922e97eb400c4a68a568130e6d1db418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:55:18.120042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.120700 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.122251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1226/2461] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:55:17 2022] DELETE /identity/v3/projects/922e97eb400c4a68a568130e6d1db418 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:55:18.129720 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2551cbe-011c-426e-b7f8-23f271b005e7 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.130006 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2551cbe-011c-426e-b7f8-23f271b005e7 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.130507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2551cbe-011c-426e-b7f8-23f271b005e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.150493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f2551cbe-011c-426e-b7f8-23f271b005e7 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:18.151793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f2551cbe-011c-426e-b7f8-23f271b005e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:18.228080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:18.230129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:18.274808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1236/2462] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:18.284517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b5529-db81-4020-992b-57cf181bc081 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.284878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b5529-db81-4020-992b-57cf181bc081 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.285239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b5529-db81-4020-992b-57cf181bc081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.306967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-929b5529-db81-4020-992b-57cf181bc081 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:18.308177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-929b5529-db81-4020-992b-57cf181bc081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:18.316530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1237/2463] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:18.320902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b5529-db81-4020-992b-57cf181bc081 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:18.332265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b5529-db81-4020-992b-57cf181bc081 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:18.339036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd004b-f1e0-4ec1-a232-8ceaee702b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:18.339820 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd004b-f1e0-4ec1-a232-8ceaee702b1f admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.340232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd004b-f1e0-4ec1-a232-8ceaee702b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.340510 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd004b-f1e0-4ec1-a232-8ceaee702b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.341249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd004b-f1e0-4ec1-a232-8ceaee702b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:55:18.341595 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd004b-f1e0-4ec1-a232-8ceaee702b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:18.343402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd004b-f1e0-4ec1-a232-8ceaee702b1f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:18.358341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1238/2464] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:55:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:55:18.362570 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86a6fe-7e3a-43ea-b5d3-1fe19aedaeb6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:18.362764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd004b-f1e0-4ec1-a232-8ceaee702b1f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:18.367976 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:18.369124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.369637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.370134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] PATH_INFO: `/v3/projects/9aeaba301e2e494aa3002631926924a4` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.371741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aeaba301e2e494aa3002631926924a4)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:18.373887 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:18.374210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd004b-f1e0-4ec1-a232-8ceaee702b1f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:18.379210 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb858b-0e2a-4d66-af70-903d5d9b7e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:18.380385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb858b-0e2a-4d66-af70-903d5d9b7e06 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.380669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb858b-0e2a-4d66-af70-903d5d9b7e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.380943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb858b-0e2a-4d66-af70-903d5d9b7e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.381655 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb858b-0e2a-4d66-af70-903d5d9b7e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:18.383652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb858b-0e2a-4d66-af70-903d5d9b7e06 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:18.417805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1239/2465] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:55:18 2022] POST /identity/v3/projects => generated 374 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:55:18.418911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb858b-0e2a-4d66-af70-903d5d9b7e06 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:18.443073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aeaba301e2e494aa3002631926924a4', 'request_id': 'req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.455045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aeaba301e2e494aa3002631926924a4', 'request_id': 'req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.464357 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aeaba301e2e494aa3002631926924a4', 'request_id': 'req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.480746 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] The token cache is being invalidate because project 9aeaba301e2e494aa3002631926924a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:55:18.481449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.482290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.484996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1227/2466] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:55:18 2022] DELETE /identity/v3/projects/9aeaba301e2e494aa3002631926924a4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:55:18.490115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:18.491823 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:18.496025 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb858b-0e2a-4d66-af70-903d5d9b7e06 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:18.562878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8e850-086a-4a9b-b899-ea7441438f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:18.563573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8e850-086a-4a9b-b899-ea7441438f26 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.563852 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8e850-086a-4a9b-b899-ea7441438f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.564122 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8e850-086a-4a9b-b899-ea7441438f26 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.564873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8e850-086a-4a9b-b899-ea7441438f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:18.566918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8e850-086a-4a9b-b899-ea7441438f26 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:18.567071 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5bcf1-0be0-41e5-934d-39bde5b03d1b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:18.573758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:18.574717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.575036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.575321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] PATH_INFO: `/v3/users/89cc490b489d4d2a972fcb2595c8f063` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.576553 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89cc490b489d4d2a972fcb2595c8f063)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:18.579578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:18.591777 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1240/2467] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:55:18 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:55:18.595411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8e850-086a-4a9b-b899-ea7441438f26 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:18.598554 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-64f8e850-086a-4a9b-b899-ea7441438f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:18.610644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8e850-086a-4a9b-b899-ea7441438f26 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:18.616042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fca96-ca56-4bde-bcec-08b518fa3a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:18.616791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fca96-ca56-4bde-bcec-08b518fa3a82 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.617072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fca96-ca56-4bde-bcec-08b518fa3a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.617561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fca96-ca56-4bde-bcec-08b518fa3a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.618338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fca96-ca56-4bde-bcec-08b518fa3a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:18.620071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fca96-ca56-4bde-bcec-08b518fa3a82 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:18.633479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1241/2468] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:18 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:55:18.639583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fca96-ca56-4bde-bcec-08b518fa3a82 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:18.645678 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89cc490b489d4d2a972fcb2595c8f063'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.652304 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fca96-ca56-4bde-bcec-08b518fa3a82 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:18.655828 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89cc490b489d4d2a972fcb2595c8f063'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.659524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b206d-06d7-45aa-866b-19067294e0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:18.660203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b206d-06d7-45aa-866b-19067294e0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.660486 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b206d-06d7-45aa-866b-19067294e0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.660760 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b206d-06d7-45aa-866b-19067294e0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.661495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b206d-06d7-45aa-866b-19067294e0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:18.663128 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b206d-06d7-45aa-866b-19067294e0f1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:18.664557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89cc490b489d4d2a972fcb2595c8f063'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.674661 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1242/2469] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:18 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:55:18.676506 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b206d-06d7-45aa-866b-19067294e0f1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:18.678061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89cc490b489d4d2a972fcb2595c8f063'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.678831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89cc490b489d4d2a972fcb2595c8f063'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.679979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5e0b206d-06d7-45aa-866b-19067294e0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:18.685143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1228/2470] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:55:18 2022] DELETE /identity/v3/users/89cc490b489d4d2a972fcb2595c8f063 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:18.688157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:18.688157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:18.695379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b206d-06d7-45aa-866b-19067294e0f1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:18.759586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:18.760655 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.760944 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.761232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] PATH_INFO: `/v3/users/43bca89ee28143d780d350c37b3af65c` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.762481 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43bca89ee28143d780d350c37b3af65c)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:18.765057 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:18.780218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed998-2d13-489d-af01-19abc639e5f3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:18.787194 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6750-24f5-4bc9-9607-9cd58a6c588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:18.788225 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6750-24f5-4bc9-9607-9cd58a6c588c admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.788581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6750-24f5-4bc9-9607-9cd58a6c588c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.788936 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6750-24f5-4bc9-9607-9cd58a6c588c admin admin] PATH_INFO: `/v3/projects/511e72017a4b4da7a0748dae5a59e0ac/users/ef20979970584d92b04462166e7059b6/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.811039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b6750-24f5-4bc9-9607-9cd58a6c588c admin admin] RBAC: Authorizing `identity:create_grant(project_id=511e72017a4b4da7a0748dae5a59e0ac, user_id=ef20979970584d92b04462166e7059b6, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:18.815371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b6750-24f5-4bc9-9607-9cd58a6c588c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:18.825664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43bca89ee28143d780d350c37b3af65c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.835589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1229/2471] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:18 2022] PUT /identity/v3/projects/511e72017a4b4da7a0748dae5a59e0ac/users/ef20979970584d92b04462166e7059b6/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:18.841362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63129f-b553-4df4-8040-50849c019a47 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:18.841653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63129f-b553-4df4-8040-50849c019a47 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:18.841898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43bca89ee28143d780d350c37b3af65c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.842059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63129f-b553-4df4-8040-50849c019a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:18.842586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43bca89ee28143d780d350c37b3af65c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.843271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43bca89ee28143d780d350c37b3af65c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.864151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43bca89ee28143d780d350c37b3af65c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:18.868586 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-dd63129f-b553-4df4-8040-50849c019a47 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:18.870250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dd63129f-b553-4df4-8040-50849c019a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:18.888944 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1243/2472] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:55:18 2022] DELETE /identity/v3/users/43bca89ee28143d780d350c37b3af65c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:18.936597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:18.938468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:18.959426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1230/2473] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:19.004233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63129f-b553-4df4-8040-50849c019a47 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.005751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-dd63129f-b553-4df4-8040-50849c019a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:19.029863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00490a05-7f2c-42f2-aefb-82b3111afbe2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.036751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.038089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.038585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.039135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] PATH_INFO: `/v3/projects/e97490f295204ca1a6d331c7ee0c9b66` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.040757 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97490f295204ca1a6d331c7ee0c9b66)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.043020 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.091515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63129f-b553-4df4-8040-50849c019a47 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.114501 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97490f295204ca1a6d331c7ee0c9b66', 'request_id': 'req-99ae4922-68fb-423e-abd7-c249d67324ca'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:19.126570 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97490f295204ca1a6d331c7ee0c9b66', 'request_id': 'req-99ae4922-68fb-423e-abd7-c249d67324ca'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:19.143759 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97490f295204ca1a6d331c7ee0c9b66', 'request_id': 'req-99ae4922-68fb-423e-abd7-c249d67324ca'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:19.160947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463b6c2-3846-4916-a841-0f145f654569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.161613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b6c2-3846-4916-a841-0f145f654569 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.161747 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] The token cache is being invalidate because project e97490f295204ca1a6d331c7ee0c9b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:55:19.162295 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:19.162957 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b6c2-3846-4916-a841-0f145f654569 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.163246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b6c2-3846-4916-a841-0f145f654569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.164297 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-99ae4922-68fb-423e-abd7-c249d67324ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:19.165106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1463b6c2-3846-4916-a841-0f145f654569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:19.166808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1244/2474] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:55:18 2022] DELETE /identity/v3/projects/e97490f295204ca1a6d331c7ee0c9b66 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:55:19.174853 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e3e65-9b56-4efc-b7ac-0669d78fcd6b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.175145 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e3e65-9b56-4efc-b7ac-0669d78fcd6b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.175434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e3e65-9b56-4efc-b7ac-0669d78fcd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.214891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4e2e3e65-9b56-4efc-b7ac-0669d78fcd6b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:19.224199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4e2e3e65-9b56-4efc-b7ac-0669d78fcd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:19.245246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463b6c2-3846-4916-a841-0f145f654569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.246642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463b6c2-3846-4916-a841-0f145f654569 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.258900 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1231/2475] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:55:19.259754 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463b6c2-3846-4916-a841-0f145f654569 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.262032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1463b6c2-3846-4916-a841-0f145f654569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:19.273586 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463b6c2-3846-4916-a841-0f145f654569 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.279265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.280142 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.280783 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.280901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] PATH_INFO: `/v3/projects/772de9e75506447b87526f3e1f2cf34f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.282268 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772de9e75506447b87526f3e1f2cf34f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.284210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.288994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1245/2476] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:19.298494 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fed18-d32c-4ce2-8f51-0260bc484d16 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.298798 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fed18-d32c-4ce2-8f51-0260bc484d16 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.299420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fed18-d32c-4ce2-8f51-0260bc484d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.321267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-232fed18-d32c-4ce2-8f51-0260bc484d16 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:19.322436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-232fed18-d32c-4ce2-8f51-0260bc484d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:19.339651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772de9e75506447b87526f3e1f2cf34f', 'request_id': 'req-39ee9225-531a-42c3-863d-c74f0c1c7bf1'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:19.349265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772de9e75506447b87526f3e1f2cf34f', 'request_id': 'req-39ee9225-531a-42c3-863d-c74f0c1c7bf1'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:19.356821 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772de9e75506447b87526f3e1f2cf34f', 'request_id': 'req-39ee9225-531a-42c3-863d-c74f0c1c7bf1'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:19.368595 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] The token cache is being invalidate because project 772de9e75506447b87526f3e1f2cf34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:55:19.368887 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:19.370264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-39ee9225-531a-42c3-863d-c74f0c1c7bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:19.372222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1232/2477] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:55:19 2022] DELETE /identity/v3/projects/772de9e75506447b87526f3e1f2cf34f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:19.378359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91a3e-348d-40c1-85b2-40f6d8d6294c None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.379324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91a3e-348d-40c1-85b2-40f6d8d6294c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.379324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91a3e-348d-40c1-85b2-40f6d8d6294c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.387414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1246/2478] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:55:19.391449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fed18-d32c-4ce2-8f51-0260bc484d16 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.399953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-edf91a3e-348d-40c1-85b2-40f6d8d6294c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:19.400678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fed18-d32c-4ce2-8f51-0260bc484d16 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.401325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-edf91a3e-348d-40c1-85b2-40f6d8d6294c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:19.405275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f779f-8c85-492a-828f-b48d12b67dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.405913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f779f-8c85-492a-828f-b48d12b67dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.406222 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f779f-8c85-492a-828f-b48d12b67dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.406499 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f779f-8c85-492a-828f-b48d12b67dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.407470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f779f-8c85-492a-828f-b48d12b67dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:55:19.407945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f779f-8c85-492a-828f-b48d12b67dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.409359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f779f-8c85-492a-828f-b48d12b67dd6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.415068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1233/2479] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:19.420299 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15c0c-f799-4d73-87b6-413db5543070 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.421462 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15c0c-f799-4d73-87b6-413db5543070 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.421973 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1247/2480] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:55:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:55:19.422409 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15c0c-f799-4d73-87b6-413db5543070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.428494 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f779f-8c85-492a-828f-b48d12b67dd6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.442939 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f779f-8c85-492a-828f-b48d12b67dd6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.445263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-3fa15c0c-f799-4d73-87b6-413db5543070 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:19.446697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3fa15c0c-f799-4d73-87b6-413db5543070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:19.450675 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cbbe0-5e58-4169-87cb-ddd271d7d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.452130 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbbe0-5e58-4169-87cb-ddd271d7d092 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.452414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbbe0-5e58-4169-87cb-ddd271d7d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.452685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbbe0-5e58-4169-87cb-ddd271d7d092 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.454434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cbbe0-5e58-4169-87cb-ddd271d7d092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.459348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1234/2481] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:19.459508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cbbe0-5e58-4169-87cb-ddd271d7d092 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.461471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa15c0c-f799-4d73-87b6-413db5543070 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.472983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa15c0c-f799-4d73-87b6-413db5543070 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.480412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748a09f-62b0-44eb-bdde-35d40afe43f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.481193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748a09f-62b0-44eb-bdde-35d40afe43f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.481791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748a09f-62b0-44eb-bdde-35d40afe43f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.482274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748a09f-62b0-44eb-bdde-35d40afe43f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.483747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748a09f-62b0-44eb-bdde-35d40afe43f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:55:19.484127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748a09f-62b0-44eb-bdde-35d40afe43f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.486733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748a09f-62b0-44eb-bdde-35d40afe43f7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.496550 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1248/2482] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:55:19 2022] POST /identity/v3/projects => generated 378 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:55:19.497835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cbbe0-5e58-4169-87cb-ddd271d7d092 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.502840 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1235/2483] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:55:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:55:19.506804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748a09f-62b0-44eb-bdde-35d40afe43f7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.517761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748a09f-62b0-44eb-bdde-35d40afe43f7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.567605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cbbe0-5e58-4169-87cb-ddd271d7d092 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.572647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add2d92-303e-4bc9-9969-66acfd8f3a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.573320 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2d92-303e-4bc9-9969-66acfd8f3a97 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.573599 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2d92-303e-4bc9-9969-66acfd8f3a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.573873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2d92-303e-4bc9-9969-66acfd8f3a97 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.574579 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add2d92-303e-4bc9-9969-66acfd8f3a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.576659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add2d92-303e-4bc9-9969-66acfd8f3a97 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.580387 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f595c1-2647-44be-a83c-ddf482b9caeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.581315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f595c1-2647-44be-a83c-ddf482b9caeb admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.581664 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f595c1-2647-44be-a83c-ddf482b9caeb admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.582036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f595c1-2647-44be-a83c-ddf482b9caeb admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.582981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f595c1-2647-44be-a83c-ddf482b9caeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.585032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f595c1-2647-44be-a83c-ddf482b9caeb admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.599896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1249/2484] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:55:19 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:55:19.604118 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add2d92-303e-4bc9-9969-66acfd8f3a97 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.616048 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1236/2485] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:55:19 2022] POST /identity/v3/projects => generated 380 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:55:19.619836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add2d92-303e-4bc9-9969-66acfd8f3a97 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.619984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f595c1-2647-44be-a83c-ddf482b9caeb admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.680683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca00c6d-ff6a-4566-b225-0b372f50ba4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.681353 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca00c6d-ff6a-4566-b225-0b372f50ba4d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.681632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca00c6d-ff6a-4566-b225-0b372f50ba4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.681911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca00c6d-ff6a-4566-b225-0b372f50ba4d admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.682652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca00c6d-ff6a-4566-b225-0b372f50ba4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.684438 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca00c6d-ff6a-4566-b225-0b372f50ba4d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.685916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f595c1-2647-44be-a83c-ddf482b9caeb admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.691688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb35b6d-46eb-49ac-8abd-8363c6210241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.692471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb35b6d-46eb-49ac-8abd-8363c6210241 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.692675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb35b6d-46eb-49ac-8abd-8363c6210241 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.692913 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb35b6d-46eb-49ac-8abd-8363c6210241 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.693621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb35b6d-46eb-49ac-8abd-8363c6210241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.695573 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb35b6d-46eb-49ac-8abd-8363c6210241 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.699218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1250/2486] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:19 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:55:19.700443 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca00c6d-ff6a-4566-b225-0b372f50ba4d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.712135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca00c6d-ff6a-4566-b225-0b372f50ba4d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.717596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1237/2487] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:55:19 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:55:19.718685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97e2cf-e271-4c96-965e-273caae870bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.720055 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97e2cf-e271-4c96-965e-273caae870bf admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.720348 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97e2cf-e271-4c96-965e-273caae870bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.720778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97e2cf-e271-4c96-965e-273caae870bf admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.721828 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97e2cf-e271-4c96-965e-273caae870bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.721971 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb35b6d-46eb-49ac-8abd-8363c6210241 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.724124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97e2cf-e271-4c96-965e-273caae870bf admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.737846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb35b6d-46eb-49ac-8abd-8363c6210241 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.738050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1251/2488] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:19 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:55:19.739244 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97e2cf-e271-4c96-965e-273caae870bf admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.743898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5320dd5-b978-4a70-bb90-cb6b407c61a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.744757 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5320dd5-b978-4a70-bb90-cb6b407c61a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.745134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5320dd5-b978-4a70-bb90-cb6b407c61a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.745454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5320dd5-b978-4a70-bb90-cb6b407c61a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.746447 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5320dd5-b978-4a70-bb90-cb6b407c61a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.748240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5320dd5-b978-4a70-bb90-cb6b407c61a7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.749232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97e2cf-e271-4c96-965e-273caae870bf admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.756454 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2650e0-e36a-489c-a51d-5fc4d147638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.757459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2650e0-e36a-489c-a51d-5fc4d147638c admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.757779 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2650e0-e36a-489c-a51d-5fc4d147638c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.758065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2650e0-e36a-489c-a51d-5fc4d147638c admin admin] PATH_INFO: `/v3/projects/b4679e09188449aa8022cfbc2168cb94/users/b8d797c7ad6a4f2ca4b91bc2007f870f/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.762086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1238/2489] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:19 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:55:19.766824 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5320dd5-b978-4a70-bb90-cb6b407c61a7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.776907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5320dd5-b978-4a70-bb90-cb6b407c61a7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.783204 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ca59e-4eee-4c31-b562-2d8b0e08c6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.783861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ca59e-4eee-4c31-b562-2d8b0e08c6ef admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.784145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ca59e-4eee-4c31-b562-2d8b0e08c6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.784417 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ca59e-4eee-4c31-b562-2d8b0e08c6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.785152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ca59e-4eee-4c31-b562-2d8b0e08c6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.786814 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ca59e-4eee-4c31-b562-2d8b0e08c6ef admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.795918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2650e0-e36a-489c-a51d-5fc4d147638c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4679e09188449aa8022cfbc2168cb94, user_id=b8d797c7ad6a4f2ca4b91bc2007f870f, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.798956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1239/2490] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:19 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:55:19.799508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2650e0-e36a-489c-a51d-5fc4d147638c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.802216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ca59e-4eee-4c31-b562-2d8b0e08c6ef admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.813696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ca59e-4eee-4c31-b562-2d8b0e08c6ef admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:19.818981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd524b-3b79-4e3c-9068-1fd9ce8b5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:19.819871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd524b-3b79-4e3c-9068-1fd9ce8b5cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.820155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd524b-3b79-4e3c-9068-1fd9ce8b5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.820478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd524b-3b79-4e3c-9068-1fd9ce8b5cd5 admin admin] PATH_INFO: `/v3/projects/7a337369b3dc467394f2629fb2f8487c/users/40a416737b484014bb7cf011bab63b63/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.823333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1252/2491] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:19 2022] PUT /identity/v3/projects/b4679e09188449aa8022cfbc2168cb94/users/b8d797c7ad6a4f2ca4b91bc2007f870f/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:19.834724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91548e-b970-45b5-8881-ca8e4eebb62f None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.835054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91548e-b970-45b5-8881-ca8e4eebb62f None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.835341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91548e-b970-45b5-8881-ca8e4eebb62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.838894 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd524b-3b79-4e3c-9068-1fd9ce8b5cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a337369b3dc467394f2629fb2f8487c, user_id=40a416737b484014bb7cf011bab63b63, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:19.841561 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd524b-3b79-4e3c-9068-1fd9ce8b5cd5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:19.857218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1240/2492] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:19 2022] PUT /identity/v3/projects/7a337369b3dc467394f2629fb2f8487c/users/40a416737b484014bb7cf011bab63b63/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:19.862759 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663a950-cb5c-425a-aca5-b4e2cf04a731 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:19.863081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663a950-cb5c-425a-aca5-b4e2cf04a731 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:19.863706 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663a950-cb5c-425a-aca5-b4e2cf04a731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:19.867183 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-6a91548e-b970-45b5-8881-ca8e4eebb62f None None] MFA Rules not processed for user `b8d797c7ad6a4f2ca4b91bc2007f870f`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:19.868606 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6a91548e-b970-45b5-8881-ca8e4eebb62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:19.882707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-0663a950-cb5c-425a-aca5-b4e2cf04a731 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:19.883979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0663a950-cb5c-425a-aca5-b4e2cf04a731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:19.944282 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1253/2493] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:55:19.956479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91548e-b970-45b5-8881-ca8e4eebb62f None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.958670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6a91548e-b970-45b5-8881-ca8e4eebb62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:19.963203 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1241/2494] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:19.974719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663a950-cb5c-425a-aca5-b4e2cf04a731 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:19.976168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0663a950-cb5c-425a-aca5-b4e2cf04a731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:20.026484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91548e-b970-45b5-8881-ca8e4eebb62f None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:20.030376 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c3003-f8b4-41b7-9f3f-1258e31580e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2691f7bb4ed84de4bb5901710a96d766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:20.031091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c3003-f8b4-41b7-9f3f-1258e31580e1 service glance] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:20.032094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c3003-f8b4-41b7-9f3f-1258e31580e1 service glance] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:20.032449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c3003-f8b4-41b7-9f3f-1258e31580e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:20.041885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663a950-cb5c-425a-aca5-b4e2cf04a731 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:20.042347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c3003-f8b4-41b7-9f3f-1258e31580e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:20.043913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c3003-f8b4-41b7-9f3f-1258e31580e1 service glance] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:20.045977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a149d6f-d263-4429-bdfb-c51f520d0f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:20.046527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a149d6f-d263-4429-bdfb-c51f520d0f53 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:20.046879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a149d6f-d263-4429-bdfb-c51f520d0f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:20.047171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a149d6f-d263-4429-bdfb-c51f520d0f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:20.054554 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1254/2495] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:55:20.069445 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a149d6f-d263-4429-bdfb-c51f520d0f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:20.071536 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a149d6f-d263-4429-bdfb-c51f520d0f53 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:20.091348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1242/2496] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:55:21.176229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c3003-f8b4-41b7-9f3f-1258e31580e1 service glance] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:21.177710 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8f2c3003-f8b4-41b7-9f3f-1258e31580e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:21.195062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c3003-f8b4-41b7-9f3f-1258e31580e1 service glance] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:21.200981 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a6dcd-a72f-4d86-82df-d297f5f9aa4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:21.201826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a6dcd-a72f-4d86-82df-d297f5f9aa4f service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:21.202119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a6dcd-a72f-4d86-82df-d297f5f9aa4f service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:21.204495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a6dcd-a72f-4d86-82df-d297f5f9aa4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:21.216190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ea7a6dcd-a72f-4d86-82df-d297f5f9aa4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:21.367102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a6dcd-a72f-4d86-82df-d297f5f9aa4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:21.368841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a6dcd-a72f-4d86-82df-d297f5f9aa4f service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:21.384619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1255/2497] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:24.361620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a149d6f-d263-4429-bdfb-c51f520d0f53 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:24.363288 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9a149d6f-d263-4429-bdfb-c51f520d0f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:24.459206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a149d6f-d263-4429-bdfb-c51f520d0f53 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:24.463860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1445d1-bd88-4890-ba3f-bb20faf819e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:24.465032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1445d1-bd88-4890-ba3f-bb20faf819e2 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:24.467586 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1445d1-bd88-4890-ba3f-bb20faf819e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:24.467870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1445d1-bd88-4890-ba3f-bb20faf819e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:24.470116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8d1445d1-bd88-4890-ba3f-bb20faf819e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:24.503412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1445d1-bd88-4890-ba3f-bb20faf819e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:24.504884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1445d1-bd88-4890-ba3f-bb20faf819e2 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:24.545324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1243/2498] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:25.470360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a6dcd-a72f-4d86-82df-d297f5f9aa4f service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:25.482803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a6dcd-a72f-4d86-82df-d297f5f9aa4f service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:25.498557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7e79-3e80-4067-9761-7916ce145968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:25.499261 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7e79-3e80-4067-9761-7916ce145968 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:25.500165 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7e79-3e80-4067-9761-7916ce145968 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:25.500456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7e79-3e80-4067-9761-7916ce145968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:25.502680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-26ef7e79-3e80-4067-9761-7916ce145968 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:25.643641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7e79-3e80-4067-9761-7916ce145968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:25.645124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7e79-3e80-4067-9761-7916ce145968 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:25.664377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1256/2499] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:27.408751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4f3e3-605c-4f06-be5b-637cc99e5a4c None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:27.409274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4f3e3-605c-4f06-be5b-637cc99e5a4c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:27.409274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4f3e3-605c-4f06-be5b-637cc99e5a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:27.448987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7eb4f3e3-605c-4f06-be5b-637cc99e5a4c None None] MFA Rules not processed for user `ef20979970584d92b04462166e7059b6`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:27.449853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7eb4f3e3-605c-4f06-be5b-637cc99e5a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:27.564005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1244/2500] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:27.568847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7e79-3e80-4067-9761-7916ce145968 service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:27.570971 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-26ef7e79-3e80-4067-9761-7916ce145968 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:27.612386 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7e79-3e80-4067-9761-7916ce145968 service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:27.621702 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dcf86-f618-490b-82e6-2f7e9438f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:27.622380 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dcf86-f618-490b-82e6-2f7e9438f2ac admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:27.622670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dcf86-f618-490b-82e6-2f7e9438f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:27.623040 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dcf86-f618-490b-82e6-2f7e9438f2ac admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:27.623761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dcf86-f618-490b-82e6-2f7e9438f2ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:27.626688 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dcf86-f618-490b-82e6-2f7e9438f2ac admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:27.665159 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4f3e3-605c-4f06-be5b-637cc99e5a4c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:27.670902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1257/2501] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:55:27 2022] POST /identity/v3/projects => generated 372 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:55:27.681539 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4f3e3-605c-4f06-be5b-637cc99e5a4c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:27.744061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e26e5-b945-40de-bbea-02781a358e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:27.744736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e26e5-b945-40de-bbea-02781a358e14 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:27.745019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e26e5-b945-40de-bbea-02781a358e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:27.745292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e26e5-b945-40de-bbea-02781a358e14 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:27.746000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e26e5-b945-40de-bbea-02781a358e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:27.748070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e26e5-b945-40de-bbea-02781a358e14 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:27.772684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1245/2502] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:55:27 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:55:27.776622 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dcf86-f618-490b-82e6-2f7e9438f2ac admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:27.794919 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dcf86-f618-490b-82e6-2f7e9438f2ac admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:27.807900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f33bf6-32b6-4896-aab2-79759196fea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:27.808992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33bf6-32b6-4896-aab2-79759196fea1 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:27.809431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33bf6-32b6-4896-aab2-79759196fea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:27.809858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33bf6-32b6-4896-aab2-79759196fea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:27.810853 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33bf6-32b6-4896-aab2-79759196fea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:27.812752 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33bf6-32b6-4896-aab2-79759196fea1 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:27.824350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1258/2503] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:27 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:55:27.829398 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e26e5-b945-40de-bbea-02781a358e14 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:27.842047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e26e5-b945-40de-bbea-02781a358e14 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:27.847632 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbc5a9-7a41-4d6c-b941-d87e64ec725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:27.848531 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc5a9-7a41-4d6c-b941-d87e64ec725f admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:27.848813 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc5a9-7a41-4d6c-b941-d87e64ec725f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:27.849089 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc5a9-7a41-4d6c-b941-d87e64ec725f admin admin] PATH_INFO: `/v3/projects/c9990d4896bc4ec48723c91c13213cc5/users/a0aba7b875194e7e8a6426648f0b12bb/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:27.867786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbc5a9-7a41-4d6c-b941-d87e64ec725f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9990d4896bc4ec48723c91c13213cc5, user_id=a0aba7b875194e7e8a6426648f0b12bb, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:27.870493 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbc5a9-7a41-4d6c-b941-d87e64ec725f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:27.894334 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1246/2504] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:27 2022] PUT /identity/v3/projects/c9990d4896bc4ec48723c91c13213cc5/users/a0aba7b875194e7e8a6426648f0b12bb/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:27.898391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f33bf6-32b6-4896-aab2-79759196fea1 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:27.912293 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f33bf6-32b6-4896-aab2-79759196fea1 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:28.014579 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd27e2-5e31-4a41-8953-eae442efba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:28.016399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd27e2-5e31-4a41-8953-eae442efba5d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:28.016764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd27e2-5e31-4a41-8953-eae442efba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:28.017107 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd27e2-5e31-4a41-8953-eae442efba5d admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:28.017924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd27e2-5e31-4a41-8953-eae442efba5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:28.019705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd27e2-5e31-4a41-8953-eae442efba5d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:28.039448 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1259/2505] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:27 2022] GET /identity/v3/roles => generated 1427 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:55:28.044111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbc5a9-7a41-4d6c-b941-d87e64ec725f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:28.059717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbc5a9-7a41-4d6c-b941-d87e64ec725f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:28.078377 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8cc52-adf0-4dd4-855f-0f28d026ce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:28.079740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8cc52-adf0-4dd4-855f-0f28d026ce04 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:28.080026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8cc52-adf0-4dd4-855f-0f28d026ce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:28.080307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8cc52-adf0-4dd4-855f-0f28d026ce04 admin admin] PATH_INFO: `/v3/projects/c9990d4896bc4ec48723c91c13213cc5/users/a0aba7b875194e7e8a6426648f0b12bb/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:28.087901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8cc52-adf0-4dd4-855f-0f28d026ce04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9990d4896bc4ec48723c91c13213cc5, user_id=a0aba7b875194e7e8a6426648f0b12bb, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:28.095306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8cc52-adf0-4dd4-855f-0f28d026ce04 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:28.118834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac1a7-afed-4052-b194-ac2a3c09c79a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:28.119151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac1a7-afed-4052-b194-ac2a3c09c79a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:28.119524 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac1a7-afed-4052-b194-ac2a3c09c79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:28.129581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1247/2506] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:28 2022] PUT /identity/v3/projects/c9990d4896bc4ec48723c91c13213cc5/users/a0aba7b875194e7e8a6426648f0b12bb/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:28.186978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-877ac1a7-afed-4052-b194-ac2a3c09c79a None None] MFA Rules not processed for user `40a416737b484014bb7cf011bab63b63`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:28.188415 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-877ac1a7-afed-4052-b194-ac2a3c09c79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:28.289236 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8cc52-adf0-4dd4-855f-0f28d026ce04 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:28.290834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1260/2507] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:55:28.386908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8cc52-adf0-4dd4-855f-0f28d026ce04 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:28.393097 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e4f8e-7bed-462a-959f-39dc7bcc3b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:28.410205 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e4f8e-7bed-462a-959f-39dc7bcc3b85 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:28.410937 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e4f8e-7bed-462a-959f-39dc7bcc3b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:28.412528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e4f8e-7bed-462a-959f-39dc7bcc3b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:28.413422 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e4f8e-7bed-462a-959f-39dc7bcc3b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:28.417355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e4f8e-7bed-462a-959f-39dc7bcc3b85 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:28.452688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1248/2508] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:55:28 2022] POST /identity/v3/projects => generated 378 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:55:28.456607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ac1a7-afed-4052-b194-ac2a3c09c79a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:28.470911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ac1a7-afed-4052-b194-ac2a3c09c79a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:28.582432 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4e397-45c0-4fc1-85a8-943081302ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:28.584378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4e397-45c0-4fc1-85a8-943081302ada admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:28.584878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4e397-45c0-4fc1-85a8-943081302ada admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:28.585377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4e397-45c0-4fc1-85a8-943081302ada admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:28.586416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4e397-45c0-4fc1-85a8-943081302ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:28.590258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4e397-45c0-4fc1-85a8-943081302ada admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:28.636675 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1261/2509] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:55:28 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:55:28.640835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e4f8e-7bed-462a-959f-39dc7bcc3b85 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:28.656978 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e4f8e-7bed-462a-959f-39dc7bcc3b85 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:28.679724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37509da1-0b16-496d-bb64-0f6c134b921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:28.680412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37509da1-0b16-496d-bb64-0f6c134b921c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:28.680695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37509da1-0b16-496d-bb64-0f6c134b921c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:28.680971 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37509da1-0b16-496d-bb64-0f6c134b921c admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:28.682053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37509da1-0b16-496d-bb64-0f6c134b921c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:28.683695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37509da1-0b16-496d-bb64-0f6c134b921c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:28.711589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1249/2510] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:28 2022] GET /identity/v3/roles => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:55:28.715531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4e397-45c0-4fc1-85a8-943081302ada admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:28.730164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4e397-45c0-4fc1-85a8-943081302ada admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:28.762556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7a404-df0a-4b3e-98da-4b72afc6427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:28.763772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7a404-df0a-4b3e-98da-4b72afc6427a admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:28.766388 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7a404-df0a-4b3e-98da-4b72afc6427a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:28.766672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7a404-df0a-4b3e-98da-4b72afc6427a admin admin] PATH_INFO: `/v3/projects/9c788630268b42d8ad7b2ea44bb36048/users/9f3da4e5da5643799926f134bd7ee135/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:28.807912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7a404-df0a-4b3e-98da-4b72afc6427a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c788630268b42d8ad7b2ea44bb36048, user_id=9f3da4e5da5643799926f134bd7ee135, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:28.817724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7a404-df0a-4b3e-98da-4b72afc6427a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:28.839825 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1262/2511] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:28 2022] PUT /identity/v3/projects/9c788630268b42d8ad7b2ea44bb36048/users/9f3da4e5da5643799926f134bd7ee135/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:28.846711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37509da1-0b16-496d-bb64-0f6c134b921c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:28.864763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37509da1-0b16-496d-bb64-0f6c134b921c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:28.958018 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa2f4f-fffe-40e9-bb5a-3178d5eb74e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:28.958541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2f4f-fffe-40e9-bb5a-3178d5eb74e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:28.959720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2f4f-fffe-40e9-bb5a-3178d5eb74e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:28.959720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2f4f-fffe-40e9-bb5a-3178d5eb74e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:28.960030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa2f4f-fffe-40e9-bb5a-3178d5eb74e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:28.961994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa2f4f-fffe-40e9-bb5a-3178d5eb74e3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:28.974140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1250/2512] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:28 2022] GET /identity/v3/roles => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:55:28.980403 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7a404-df0a-4b3e-98da-4b72afc6427a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:28.992704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7a404-df0a-4b3e-98da-4b72afc6427a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:29.002826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5173a4-353d-4617-a437-c289cc79aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:29.003998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5173a4-353d-4617-a437-c289cc79aa64 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:29.004474 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5173a4-353d-4617-a437-c289cc79aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:29.004927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5173a4-353d-4617-a437-c289cc79aa64 admin admin] PATH_INFO: `/v3/projects/9c788630268b42d8ad7b2ea44bb36048/users/9f3da4e5da5643799926f134bd7ee135/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:29.015041 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5173a4-353d-4617-a437-c289cc79aa64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c788630268b42d8ad7b2ea44bb36048, user_id=9f3da4e5da5643799926f134bd7ee135, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:29.021167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5173a4-353d-4617-a437-c289cc79aa64 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:29.052313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1263/2513] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:28 2022] PUT /identity/v3/projects/9c788630268b42d8ad7b2ea44bb36048/users/9f3da4e5da5643799926f134bd7ee135/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:55:37.773352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3203d1-6224-4d82-b6d7-6c1eb53ecf28 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:37.773961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3203d1-6224-4d82-b6d7-6c1eb53ecf28 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:37.773961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3203d1-6224-4d82-b6d7-6c1eb53ecf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:37.833950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-df3203d1-6224-4d82-b6d7-6c1eb53ecf28 None None] MFA Rules not processed for user `a0aba7b875194e7e8a6426648f0b12bb`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:37.841055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-df3203d1-6224-4d82-b6d7-6c1eb53ecf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:38.007937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5173a4-353d-4617-a437-c289cc79aa64 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:38.009917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5a5173a4-353d-4617-a437-c289cc79aa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:38.016359 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1251/2514] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:38.148162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5173a4-353d-4617-a437-c289cc79aa64 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:38.165706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f7b93-efbf-4ecb-93e5-bf9151884518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:38.166665 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7b93-efbf-4ecb-93e5-bf9151884518 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:38.167169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7b93-efbf-4ecb-93e5-bf9151884518 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:38.167618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7b93-efbf-4ecb-93e5-bf9151884518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:38.314613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f7b93-efbf-4ecb-93e5-bf9151884518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:38.317526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f7b93-efbf-4ecb-93e5-bf9151884518 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:38.331448 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1264/2515] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:55:38.551852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebd56c-5b70-460c-a214-3de2223c5139 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:38.552147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebd56c-5b70-460c-a214-3de2223c5139 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:38.552664 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebd56c-5b70-460c-a214-3de2223c5139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:38.632866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-10ebd56c-5b70-460c-a214-3de2223c5139 None None] MFA Rules not processed for user `9f3da4e5da5643799926f134bd7ee135`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:38.634208 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-10ebd56c-5b70-460c-a214-3de2223c5139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:38.700788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f7b93-efbf-4ecb-93e5-bf9151884518 service nova] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:38.801565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1252/2516] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:38.818490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebd56c-5b70-460c-a214-3de2223c5139 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:38.820806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-10ebd56c-5b70-460c-a214-3de2223c5139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:38.827892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f7b93-efbf-4ecb-93e5-bf9151884518 service nova] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:38.833031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9ebb7-2b27-4904-9e68-664f7b2da3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:38.834277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ebb7-2b27-4904-9e68-664f7b2da3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:38.834564 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ebb7-2b27-4904-9e68-664f7b2da3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:38.834889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ebb7-2b27-4904-9e68-664f7b2da3a8 admin admin] PATH_INFO: `/v3/users/b8d797c7ad6a4f2ca4b91bc2007f870f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:38.836428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9ebb7-2b27-4904-9e68-664f7b2da3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d797c7ad6a4f2ca4b91bc2007f870f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:38.839413 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9ebb7-2b27-4904-9e68-664f7b2da3a8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:38.871382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebd56c-5b70-460c-a214-3de2223c5139 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:38.884624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47763ef-e555-4be7-9f09-31f93eac8883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:38.886129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47763ef-e555-4be7-9f09-31f93eac8883 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:38.886416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47763ef-e555-4be7-9f09-31f93eac8883 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:38.886699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47763ef-e555-4be7-9f09-31f93eac8883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:38.970652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-38c9ebb7-2b27-4904-9e68-664f7b2da3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d797c7ad6a4f2ca4b91bc2007f870f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:38.995002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-38c9ebb7-2b27-4904-9e68-664f7b2da3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d797c7ad6a4f2ca4b91bc2007f870f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:38.996372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-38c9ebb7-2b27-4904-9e68-664f7b2da3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d797c7ad6a4f2ca4b91bc2007f870f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:39.000064 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-38c9ebb7-2b27-4904-9e68-664f7b2da3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d797c7ad6a4f2ca4b91bc2007f870f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:39.017352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-38c9ebb7-2b27-4904-9e68-664f7b2da3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d797c7ad6a4f2ca4b91bc2007f870f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:39.021430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47763ef-e555-4be7-9f09-31f93eac8883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:39.023802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47763ef-e555-4be7-9f09-31f93eac8883 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:39.033788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1265/2517] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:55:38 2022] DELETE /identity/v3/users/b8d797c7ad6a4f2ca4b91bc2007f870f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:39.038078 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef3401-d794-41c6-bc94-cd67d6142877 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:39.040155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1253/2518] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:55:39.051425 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef3401-d794-41c6-bc94-cd67d6142877 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:39.051719 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef3401-d794-41c6-bc94-cd67d6142877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:39.095493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-68ef3401-d794-41c6-bc94-cd67d6142877 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:39.097751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-68ef3401-d794-41c6-bc94-cd67d6142877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:39.259632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1266/2519] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:39.285882 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47763ef-e555-4be7-9f09-31f93eac8883 service nova] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:39.403040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47763ef-e555-4be7-9f09-31f93eac8883 service nova] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:39.538276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e281e3-782e-4dc5-8f25-409d5c7e2e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:39.539105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e281e3-782e-4dc5-8f25-409d5c7e2e6b service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:39.539466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e281e3-782e-4dc5-8f25-409d5c7e2e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:39.539904 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e281e3-782e-4dc5-8f25-409d5c7e2e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:39.564229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e281e3-782e-4dc5-8f25-409d5c7e2e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:39.569685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e281e3-782e-4dc5-8f25-409d5c7e2e6b service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:39.586788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1254/2520] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:40.344601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef3401-d794-41c6-bc94-cd67d6142877 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:40.346092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-68ef3401-d794-41c6-bc94-cd67d6142877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:40.361428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef3401-d794-41c6-bc94-cd67d6142877 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:40.381983 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:40.384426 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:40.384975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:40.385536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] PATH_INFO: `/v3/projects/b4679e09188449aa8022cfbc2168cb94` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:40.387391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4679e09188449aa8022cfbc2168cb94)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:40.389848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:40.480589 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4679e09188449aa8022cfbc2168cb94', 'request_id': 'req-105821db-c07a-418a-ad17-b7e59e6b3339'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:40.491393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4679e09188449aa8022cfbc2168cb94', 'request_id': 'req-105821db-c07a-418a-ad17-b7e59e6b3339'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:40.500888 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4679e09188449aa8022cfbc2168cb94', 'request_id': 'req-105821db-c07a-418a-ad17-b7e59e6b3339'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:40.519961 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] The token cache is being invalidate because project b4679e09188449aa8022cfbc2168cb94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:55:40.520370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:40.521558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-105821db-c07a-418a-ad17-b7e59e6b3339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:40.523381 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1267/2521] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:55:40 2022] DELETE /identity/v3/projects/b4679e09188449aa8022cfbc2168cb94 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:40.529405 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a98de-b6a6-4ade-bae3-04a94054b3d5 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:40.529405 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a98de-b6a6-4ade-bae3-04a94054b3d5 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:40.530736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a98de-b6a6-4ade-bae3-04a94054b3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:40.555267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b66a98de-b6a6-4ade-bae3-04a94054b3d5 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:40.564819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b66a98de-b6a6-4ade-bae3-04a94054b3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:40.650406 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1255/2522] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:40.661898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce6cc3-8a10-4833-91bf-89a1bc6b8bb6 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:40.662627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce6cc3-8a10-4833-91bf-89a1bc6b8bb6 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:40.664380 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce6cc3-8a10-4833-91bf-89a1bc6b8bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:40.714794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-28ce6cc3-8a10-4833-91bf-89a1bc6b8bb6 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:40.716266 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-28ce6cc3-8a10-4833-91bf-89a1bc6b8bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:40.730727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1268/2523] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:40.736021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a98de-b6a6-4ade-bae3-04a94054b3d5 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:40.762662 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a98de-b6a6-4ade-bae3-04a94054b3d5 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:40.781436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84374e-89de-4878-90e1-28a913dfb34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:40.782792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84374e-89de-4878-90e1-28a913dfb34b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:40.783307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84374e-89de-4878-90e1-28a913dfb34b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:40.784502 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84374e-89de-4878-90e1-28a913dfb34b admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:40.785768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84374e-89de-4878-90e1-28a913dfb34b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:55:40.786567 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84374e-89de-4878-90e1-28a913dfb34b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:40.798343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84374e-89de-4878-90e1-28a913dfb34b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:40.835528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1256/2524] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:55:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:55:40.838072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aad70-334f-4854-b298-ad1f7d124fdb None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:40.839012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aad70-334f-4854-b298-ad1f7d124fdb None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:40.839523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aad70-334f-4854-b298-ad1f7d124fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:40.842949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84374e-89de-4878-90e1-28a913dfb34b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:40.864067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-141aad70-334f-4854-b298-ad1f7d124fdb None None] MFA Rules not processed for user `50e012c5fcde4462984a57878629fd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:40.865739 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-141aad70-334f-4854-b298-ad1f7d124fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:40.871383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84374e-89de-4878-90e1-28a913dfb34b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:40.882249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae049e5-45af-4a4d-ac48-804e7613c497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:40.883291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae049e5-45af-4a4d-ac48-804e7613c497 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:40.883569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae049e5-45af-4a4d-ac48-804e7613c497 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:40.884016 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae049e5-45af-4a4d-ac48-804e7613c497 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:40.884817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae049e5-45af-4a4d-ac48-804e7613c497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:40.887157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae049e5-45af-4a4d-ac48-804e7613c497 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:40.949286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1257/2525] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:55:40 2022] POST /identity/v3/projects => generated 374 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:55:40.950369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae049e5-45af-4a4d-ac48-804e7613c497 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:40.990812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1269/2526] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:41.106624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae049e5-45af-4a4d-ac48-804e7613c497 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:41.127607 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050e3ce-a3f8-4edf-8a47-9daedd20ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:41.128430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050e3ce-a3f8-4edf-8a47-9daedd20ad44 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:41.128845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050e3ce-a3f8-4edf-8a47-9daedd20ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:41.129234 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050e3ce-a3f8-4edf-8a47-9daedd20ad44 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:41.130223 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050e3ce-a3f8-4edf-8a47-9daedd20ad44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:41.132601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050e3ce-a3f8-4edf-8a47-9daedd20ad44 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:41.181210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1258/2527] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:55:40 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:55:41.182327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aad70-334f-4854-b298-ad1f7d124fdb None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:41.197331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aad70-334f-4854-b298-ad1f7d124fdb None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:41.204102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f36ac8-8c7f-4cfe-94a0-095c2bcc4e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:41.204831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f36ac8-8c7f-4cfe-94a0-095c2bcc4e7c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:41.205117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f36ac8-8c7f-4cfe-94a0-095c2bcc4e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:41.205427 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f36ac8-8c7f-4cfe-94a0-095c2bcc4e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:41.206177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f36ac8-8c7f-4cfe-94a0-095c2bcc4e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:41.207846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f36ac8-8c7f-4cfe-94a0-095c2bcc4e7c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:41.223482 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050e3ce-a3f8-4edf-8a47-9daedd20ad44 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:41.236822 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1270/2528] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:41 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:55:41.242699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050e3ce-a3f8-4edf-8a47-9daedd20ad44 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:41.250313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43340398-da9c-4a5b-a794-30d26241ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:41.251275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43340398-da9c-4a5b-a794-30d26241ada8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:41.251736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43340398-da9c-4a5b-a794-30d26241ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:41.252156 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43340398-da9c-4a5b-a794-30d26241ada8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:41.253083 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43340398-da9c-4a5b-a794-30d26241ada8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:41.255824 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43340398-da9c-4a5b-a794-30d26241ada8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:41.268149 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1259/2529] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:41 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:55:41.272498 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f36ac8-8c7f-4cfe-94a0-095c2bcc4e7c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:41.283810 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f36ac8-8c7f-4cfe-94a0-095c2bcc4e7c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:41.289282 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0b8f-8db1-4a9a-bfc3-0e95bd2ea8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:41.290456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0b8f-8db1-4a9a-bfc3-0e95bd2ea8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:41.290735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0b8f-8db1-4a9a-bfc3-0e95bd2ea8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:41.291191 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0b8f-8db1-4a9a-bfc3-0e95bd2ea8fa admin admin] PATH_INFO: `/v3/projects/ebfa614efab1410b990c5f2ab8e69ab2/users/f43ced3eaa1848b3885887d0ccc37739/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:41.313885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0b8f-8db1-4a9a-bfc3-0e95bd2ea8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfa614efab1410b990c5f2ab8e69ab2, user_id=f43ced3eaa1848b3885887d0ccc37739, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:41.317042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0b8f-8db1-4a9a-bfc3-0e95bd2ea8fa admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:41.350144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb16c2-74f5-4fe2-bbe8-9fa44642c53d None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:41.350434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb16c2-74f5-4fe2-bbe8-9fa44642c53d None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:41.350941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb16c2-74f5-4fe2-bbe8-9fa44642c53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:41.352584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1271/2530] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:41 2022] PUT /identity/v3/projects/ebfa614efab1410b990c5f2ab8e69ab2/users/f43ced3eaa1848b3885887d0ccc37739/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:41.394909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-07fb16c2-74f5-4fe2-bbe8-9fa44642c53d None None] MFA Rules not processed for user `f43ced3eaa1848b3885887d0ccc37739`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:41.396210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-07fb16c2-74f5-4fe2-bbe8-9fa44642c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:41.492219 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a8dd5-ac7b-45e3-9276-d3275da1cb95 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:41.492878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a8dd5-ac7b-45e3-9276-d3275da1cb95 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:41.493371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a8dd5-ac7b-45e3-9276-d3275da1cb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:41.503041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1260/2531] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:41.509996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb16c2-74f5-4fe2-bbe8-9fa44642c53d None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:41.514603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-07fb16c2-74f5-4fe2-bbe8-9fa44642c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:41.540297 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-b21a8dd5-ac7b-45e3-9276-d3275da1cb95 None None] MFA Rules not processed for user `ef20979970584d92b04462166e7059b6`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:41.542226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b21a8dd5-ac7b-45e3-9276-d3275da1cb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:41.586791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb16c2-74f5-4fe2-bbe8-9fa44642c53d None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:41.596270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed38434-f114-4a09-9f0b-bb22a3ef9768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:41.596922 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed38434-f114-4a09-9f0b-bb22a3ef9768 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:41.597202 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed38434-f114-4a09-9f0b-bb22a3ef9768 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:41.597472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed38434-f114-4a09-9f0b-bb22a3ef9768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:41.616913 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed38434-f114-4a09-9f0b-bb22a3ef9768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:41.618379 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed38434-f114-4a09-9f0b-bb22a3ef9768 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:41.650358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1261/2532] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:41.661926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed38434-f114-4a09-9f0b-bb22a3ef9768 service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:41.664238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3ed38434-f114-4a09-9f0b-bb22a3ef9768 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:41.700891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1272/2533] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:41.702546 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a8dd5-ac7b-45e3-9276-d3275da1cb95 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:41.800653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed38434-f114-4a09-9f0b-bb22a3ef9768 service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:41.804923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95a626-48b9-48b6-b1d7-4a0a18f1a786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:41.805695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95a626-48b9-48b6-b1d7-4a0a18f1a786 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:41.806084 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95a626-48b9-48b6-b1d7-4a0a18f1a786 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:41.806465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95a626-48b9-48b6-b1d7-4a0a18f1a786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:41.809852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-8d95a626-48b9-48b6-b1d7-4a0a18f1a786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:41.822430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95a626-48b9-48b6-b1d7-4a0a18f1a786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:41.824532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95a626-48b9-48b6-b1d7-4a0a18f1a786 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:41.846670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a8dd5-ac7b-45e3-9276-d3275da1cb95 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:41.852188 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1262/2534] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:41.852395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:41.853569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:41.853858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:41.854134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] PATH_INFO: `/v3/users/f43ced3eaa1848b3885887d0ccc37739` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:41.855851 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f43ced3eaa1848b3885887d0ccc37739)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:41.858826 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:41.965934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f43ced3eaa1848b3885887d0ccc37739'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:41.985201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f43ced3eaa1848b3885887d0ccc37739'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:41.986801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f43ced3eaa1848b3885887d0ccc37739'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:41.988044 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f43ced3eaa1848b3885887d0ccc37739'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:42.001515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f43ced3eaa1848b3885887d0ccc37739'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:42.026903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1273/2535] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:55:41 2022] DELETE /identity/v3/users/f43ced3eaa1848b3885887d0ccc37739 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:42.031994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b476de7-1ef7-4c37-9ad5-abc566acf4a1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:42.035369 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b476de7-1ef7-4c37-9ad5-abc566acf4a1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:42.035950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b476de7-1ef7-4c37-9ad5-abc566acf4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:42.065850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-3b476de7-1ef7-4c37-9ad5-abc566acf4a1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:42.068264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3b476de7-1ef7-4c37-9ad5-abc566acf4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:42.261969 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1263/2536] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:55:42.273844 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:42.276837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:42.446975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded5376-e353-460b-b8fa-28f97b107f7b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:42.474020 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f25495-b1fe-49b5-a858-a5dec0697c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:42.488130 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25495-b1fe-49b5-a858-a5dec0697c0e service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:42.493706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25495-b1fe-49b5-a858-a5dec0697c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:42.494039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25495-b1fe-49b5-a858-a5dec0697c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:42.505476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eaa80-37dc-4721-acbc-49c2a48e7853 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:42.505764 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eaa80-37dc-4721-acbc-49c2a48e7853 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:42.506046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eaa80-37dc-4721-acbc-49c2a48e7853 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:42.508681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1264/2537] 10.222.0.117 () {54 vars in 965 bytes} [Mon Jan 24 16:55:42 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:55:42.520023 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c81d57-3cbe-4dc6-bcd3-88c73a35fc7f None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:42.520646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c81d57-3cbe-4dc6-bcd3-88c73a35fc7f None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:42.521619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c81d57-3cbe-4dc6-bcd3-88c73a35fc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:42.529114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f25495-b1fe-49b5-a858-a5dec0697c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:42.533603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f25495-b1fe-49b5-a858-a5dec0697c0e service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:42.574700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1274/2538] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:55:42.611096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-06c81d57-3cbe-4dc6-bcd3-88c73a35fc7f None None] MFA Rules not processed for user `15975bd016ed48f9bf5c88845180ebf0`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:42.612688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-06c81d57-3cbe-4dc6-bcd3-88c73a35fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:42.743436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1265/2539] 10.222.0.117 () {58 vars in 1062 bytes} [Mon Jan 24 16:55:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:55:42.767748 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f25495-b1fe-49b5-a858-a5dec0697c0e service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:42.792062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f25495-b1fe-49b5-a858-a5dec0697c0e service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:42.805678 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff749eb-ac27-4f5f-a3dc-f06350ef86e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15975bd016ed48f9bf5c88845180ebf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:42.806519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff749eb-ac27-4f5f-a3dc-f06350ef86e0 service placement] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:42.807018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff749eb-ac27-4f5f-a3dc-f06350ef86e0 service placement] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:42.807300 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff749eb-ac27-4f5f-a3dc-f06350ef86e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:42.809950 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-dff749eb-ac27-4f5f-a3dc-f06350ef86e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:42.832847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff749eb-ac27-4f5f-a3dc-f06350ef86e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:42.849488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff749eb-ac27-4f5f-a3dc-f06350ef86e0 service placement] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:42.898571 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1275/2540] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:43.134346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c81d57-3cbe-4dc6-bcd3-88c73a35fc7f None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:43.136041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-06c81d57-3cbe-4dc6-bcd3-88c73a35fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:43.167628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c81d57-3cbe-4dc6-bcd3-88c73a35fc7f None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:43.180725 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:43.181623 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:43.181946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:43.182568 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] PATH_INFO: `/v3/projects/ebfa614efab1410b990c5f2ab8e69ab2` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:43.184815 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebfa614efab1410b990c5f2ab8e69ab2)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:43.187605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:43.293261 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebfa614efab1410b990c5f2ab8e69ab2', 'request_id': 'req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:43.318638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebfa614efab1410b990c5f2ab8e69ab2', 'request_id': 'req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:43.325511 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebfa614efab1410b990c5f2ab8e69ab2', 'request_id': 'req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:43.351467 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] The token cache is being invalidate because project ebfa614efab1410b990c5f2ab8e69ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:55:43.351766 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:43.353681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b74b17ab-7409-4a31-bfc1-0585e5ebec6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:55:43.361166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1266/2541] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:55:43 2022] DELETE /identity/v3/projects/ebfa614efab1410b990c5f2ab8e69ab2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:55:43.367439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110085-4f95-4c1f-8c83-cebd127f1169 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:43.375155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110085-4f95-4c1f-8c83-cebd127f1169 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:43.375754 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110085-4f95-4c1f-8c83-cebd127f1169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:43.421473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-71110085-4f95-4c1f-8c83-cebd127f1169 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:43.422674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-71110085-4f95-4c1f-8c83-cebd127f1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:43.550359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1276/2542] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:43.559021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9fcaf-cf90-48f4-8b03-4739c705fa26 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:43.559563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9fcaf-cf90-48f4-8b03-4739c705fa26 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:43.559989 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9fcaf-cf90-48f4-8b03-4739c705fa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:43.585164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d5d9fcaf-cf90-48f4-8b03-4739c705fa26 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:43.588619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d5d9fcaf-cf90-48f4-8b03-4739c705fa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:43.601010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1267/2543] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:43.608674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71110085-4f95-4c1f-8c83-cebd127f1169 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:43.626331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71110085-4f95-4c1f-8c83-cebd127f1169 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:43.643203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b8a89-3158-4f2f-86d6-79e1a52d773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:43.643915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b8a89-3158-4f2f-86d6-79e1a52d773b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:43.644336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b8a89-3158-4f2f-86d6-79e1a52d773b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:43.644614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b8a89-3158-4f2f-86d6-79e1a52d773b admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:43.645384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b8a89-3158-4f2f-86d6-79e1a52d773b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:55:43.645689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b8a89-3158-4f2f-86d6-79e1a52d773b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:43.647683 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b8a89-3158-4f2f-86d6-79e1a52d773b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:43.666286 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1277/2544] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:55:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:55:43.670968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9fcaf-cf90-48f4-8b03-4739c705fa26 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:43.686378 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9fcaf-cf90-48f4-8b03-4739c705fa26 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:43.694881 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3b78f-f681-42b5-979e-5795d6341603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:43.696004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3b78f-f681-42b5-979e-5795d6341603 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:43.696347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3b78f-f681-42b5-979e-5795d6341603 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:43.696792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3b78f-f681-42b5-979e-5795d6341603 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:43.698535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3b78f-f681-42b5-979e-5795d6341603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:43.701003 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3b78f-f681-42b5-979e-5795d6341603 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:43.765440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1268/2545] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:55:43 2022] POST /identity/v3/projects => generated 376 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:55:43.768909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b8a89-3158-4f2f-86d6-79e1a52d773b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:43.783441 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b8a89-3158-4f2f-86d6-79e1a52d773b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:43.850946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27719633-caae-4d46-bb1b-736a66a0128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:43.851959 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27719633-caae-4d46-bb1b-736a66a0128d admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:43.852425 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27719633-caae-4d46-bb1b-736a66a0128d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:43.853717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27719633-caae-4d46-bb1b-736a66a0128d admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:43.854942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27719633-caae-4d46-bb1b-736a66a0128d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:43.856947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27719633-caae-4d46-bb1b-736a66a0128d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:43.882061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1278/2546] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:55:43 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:55:43.885885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3b78f-f681-42b5-979e-5795d6341603 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:43.901221 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3b78f-f681-42b5-979e-5795d6341603 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:43.916939 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67cca-3393-4d40-b405-2ec41e6580dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:43.918483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67cca-3393-4d40-b405-2ec41e6580dd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:43.918990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67cca-3393-4d40-b405-2ec41e6580dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:43.919436 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67cca-3393-4d40-b405-2ec41e6580dd admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:43.920464 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67cca-3393-4d40-b405-2ec41e6580dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:43.922531 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67cca-3393-4d40-b405-2ec41e6580dd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:43.940852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1269/2547] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:43 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:55:43.944151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27719633-caae-4d46-bb1b-736a66a0128d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:43.961467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27719633-caae-4d46-bb1b-736a66a0128d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:43.973994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfef19-4e76-43d1-b8a7-557e3b4e74ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:43.975260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfef19-4e76-43d1-b8a7-557e3b4e74ee admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:43.975774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfef19-4e76-43d1-b8a7-557e3b4e74ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:43.976205 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfef19-4e76-43d1-b8a7-557e3b4e74ee admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:43.976956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfef19-4e76-43d1-b8a7-557e3b4e74ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:43.978830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfef19-4e76-43d1-b8a7-557e3b4e74ee admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:43.992498 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1279/2548] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:55:43 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:55:43.996720 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67cca-3393-4d40-b405-2ec41e6580dd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:44.010574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67cca-3393-4d40-b405-2ec41e6580dd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:44.016771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab2c40-dff7-43d9-bc01-d231bd8375b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:44.017767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab2c40-dff7-43d9-bc01-d231bd8375b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:44.018113 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab2c40-dff7-43d9-bc01-d231bd8375b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:44.018624 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab2c40-dff7-43d9-bc01-d231bd8375b2 admin admin] PATH_INFO: `/v3/projects/91c6a4a7b6294557aa79bfcd9fae3cb3/users/948d485ebe0946079cf64cdac3312126/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:44.047681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab2c40-dff7-43d9-bc01-d231bd8375b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c6a4a7b6294557aa79bfcd9fae3cb3, user_id=948d485ebe0946079cf64cdac3312126, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:44.050483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab2c40-dff7-43d9-bc01-d231bd8375b2 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:44.070217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1270/2549] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:55:43 2022] PUT /identity/v3/projects/91c6a4a7b6294557aa79bfcd9fae3cb3/users/948d485ebe0946079cf64cdac3312126/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:55:44.082746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded36d8-3a4c-428e-bef8-3c5fc0480f52 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:44.083419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded36d8-3a4c-428e-bef8-3c5fc0480f52 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:44.083889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded36d8-3a4c-428e-bef8-3c5fc0480f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:44.118646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-1ded36d8-3a4c-428e-bef8-3c5fc0480f52 None None] MFA Rules not processed for user `948d485ebe0946079cf64cdac3312126`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:44.121435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1ded36d8-3a4c-428e-bef8-3c5fc0480f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:44.196884 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1280/2550] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:44.207797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab2c40-dff7-43d9-bc01-d231bd8375b2 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:44.210644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-55ab2c40-dff7-43d9-bc01-d231bd8375b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:44.275317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab2c40-dff7-43d9-bc01-d231bd8375b2 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:44.283237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e12d-a678-4b3e-a009-779a7c32fe3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:44.283903 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e12d-a678-4b3e-a009-779a7c32fe3b service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:44.284182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e12d-a678-4b3e-a009-779a7c32fe3b service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:44.284453 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e12d-a678-4b3e-a009-779a7c32fe3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:44.303628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273e12d-a678-4b3e-a009-779a7c32fe3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:44.305112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273e12d-a678-4b3e-a009-779a7c32fe3b service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:44.315386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1271/2551] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:45.340878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded36d8-3a4c-428e-bef8-3c5fc0480f52 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:45.343224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1ded36d8-3a4c-428e-bef8-3c5fc0480f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:45.425217 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded36d8-3a4c-428e-bef8-3c5fc0480f52 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:45.429563 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29c11-6411-4255-a6ba-e88d37e1ccce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:45.431214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29c11-6411-4255-a6ba-e88d37e1ccce service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:45.431214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29c11-6411-4255-a6ba-e88d37e1ccce service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:45.431214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29c11-6411-4255-a6ba-e88d37e1ccce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:45.434459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8aa29c11-6411-4255-a6ba-e88d37e1ccce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:45.446063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa29c11-6411-4255-a6ba-e88d37e1ccce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:45.447640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa29c11-6411-4255-a6ba-e88d37e1ccce service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:45.456093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1281/2552] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:55:45.809072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8555ed-a544-4150-926c-b635cf45bf68 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:45.809989 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8555ed-a544-4150-926c-b635cf45bf68 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:45.811070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8555ed-a544-4150-926c-b635cf45bf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:45.832005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-5c8555ed-a544-4150-926c-b635cf45bf68 None None] MFA Rules not processed for user `948d485ebe0946079cf64cdac3312126`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:55:45.833549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5c8555ed-a544-4150-926c-b635cf45bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:45.853203 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1272/2553] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:55:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:55:46.461345 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29c11-6411-4255-a6ba-e88d37e1ccce service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:55:46.465411 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8aa29c11-6411-4255-a6ba-e88d37e1ccce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:46.604142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29c11-6411-4255-a6ba-e88d37e1ccce service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:55:46.611759 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517b401-3864-41c7-b8a1-c77f39b10d8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:55:46.612571 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517b401-3864-41c7-b8a1-c77f39b10d8d service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:55:46.612962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517b401-3864-41c7-b8a1-c77f39b10d8d service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:55:46.613548 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517b401-3864-41c7-b8a1-c77f39b10d8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:55:46.615765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e517b401-3864-41c7-b8a1-c77f39b10d8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:55:46.644355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517b401-3864-41c7-b8a1-c77f39b10d8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:55:46.645999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517b401-3864-41c7-b8a1-c77f39b10d8d service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:55:46.671782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1282/2554] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:55:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:56:03.746843 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8555ed-a544-4150-926c-b635cf45bf68 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:03.760257 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8555ed-a544-4150-926c-b635cf45bf68 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:03.765611 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7942313-9d2c-486a-be99-a3fcab47b5fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:03.766252 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942313-9d2c-486a-be99-a3fcab47b5fe service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:03.766532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942313-9d2c-486a-be99-a3fcab47b5fe service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:03.766833 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942313-9d2c-486a-be99-a3fcab47b5fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:03.769302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f7942313-9d2c-486a-be99-a3fcab47b5fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:03.781465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7942313-9d2c-486a-be99-a3fcab47b5fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:03.783091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7942313-9d2c-486a-be99-a3fcab47b5fe service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:03.794352 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1273/2555] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:56:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:56:07.868080 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c897-3105-433b-8542-0257b7288e3d None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:07.868660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c897-3105-433b-8542-0257b7288e3d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:07.868817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c897-3105-433b-8542-0257b7288e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:07.887223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-9b18c897-3105-433b-8542-0257b7288e3d None None] MFA Rules not processed for user `40a416737b484014bb7cf011bab63b63`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:56:07.888447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9b18c897-3105-433b-8542-0257b7288e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:07.975303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1283/2556] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:56:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:56:11.219669 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7942313-9d2c-486a-be99-a3fcab47b5fe service nova] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:11.240143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7942313-9d2c-486a-be99-a3fcab47b5fe service nova] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:11.255805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552bd9-8e0c-4ea0-9dc2-25bdb48978d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:11.256472 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552bd9-8e0c-4ea0-9dc2-25bdb48978d6 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:11.256751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552bd9-8e0c-4ea0-9dc2-25bdb48978d6 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:11.257028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552bd9-8e0c-4ea0-9dc2-25bdb48978d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:11.263796 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9e552bd9-8e0c-4ea0-9dc2-25bdb48978d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:11.279836 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e552bd9-8e0c-4ea0-9dc2-25bdb48978d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:11.281741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e552bd9-8e0c-4ea0-9dc2-25bdb48978d6 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:11.307269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1274/2557] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:56:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:56:14.538053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826ac2e-ab9d-4603-a2a0-08fbb541a746 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:14.538520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826ac2e-ab9d-4603-a2a0-08fbb541a746 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:14.538613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826ac2e-ab9d-4603-a2a0-08fbb541a746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:14.556558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-6826ac2e-ab9d-4603-a2a0-08fbb541a746 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:56:14.557724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6826ac2e-ab9d-4603-a2a0-08fbb541a746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:14.611449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1284/2558] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:56:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:56:14.656515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552bd9-8e0c-4ea0-9dc2-25bdb48978d6 service nova] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:14.658729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9e552bd9-8e0c-4ea0-9dc2-25bdb48978d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:14.732238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552bd9-8e0c-4ea0-9dc2-25bdb48978d6 service nova] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:14.737468 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac8f03-e505-49aa-a770-844f7d2eeefd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:14.738108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac8f03-e505-49aa-a770-844f7d2eeefd service swift] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:14.738390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac8f03-e505-49aa-a770-844f7d2eeefd service swift] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:14.738666 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac8f03-e505-49aa-a770-844f7d2eeefd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:14.746692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac8f03-e505-49aa-a770-844f7d2eeefd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:14.748284 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac8f03-e505-49aa-a770-844f7d2eeefd service swift] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:14.758258 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1275/2559] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:56:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:56:15.285691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcca23-997f-49db-b660-d66d71607f71 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:15.285978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcca23-997f-49db-b660-d66d71607f71 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:15.286279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcca23-997f-49db-b660-d66d71607f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:15.304321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-0bbcca23-997f-49db-b660-d66d71607f71 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:56:15.305496 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-0bbcca23-997f-49db-b660-d66d71607f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:15.312639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1285/2560] 10.222.0.117 () {58 vars in 972 bytes} [Mon Jan 24 16:56:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:56:15.325026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac8f03-e505-49aa-a770-844f7d2eeefd service swift] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:15.335864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac8f03-e505-49aa-a770-844f7d2eeefd service swift] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:15.340806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6ac62-9d0d-4ff5-89a3-c23e474726a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:15.341428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6ac62-9d0d-4ff5-89a3-c23e474726a1 service swift] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:15.341710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6ac62-9d0d-4ff5-89a3-c23e474726a1 service swift] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:15.342014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6ac62-9d0d-4ff5-89a3-c23e474726a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:15.350437 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6ac62-9d0d-4ff5-89a3-c23e474726a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:15.352033 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6ac62-9d0d-4ff5-89a3-c23e474726a1 service swift] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:15.359850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1276/2561] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:56:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:56:15.541378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e72ce-8dda-4496-b2a8-b9954f10e3c2 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:15.541836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e72ce-8dda-4496-b2a8-b9954f10e3c2 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:15.541928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e72ce-8dda-4496-b2a8-b9954f10e3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:15.559439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-e45e72ce-8dda-4496-b2a8-b9954f10e3c2 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:56:15.560606 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e45e72ce-8dda-4496-b2a8-b9954f10e3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:15.568237 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1286/2562] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:56:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:56:15.580991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6ac62-9d0d-4ff5-89a3-c23e474726a1 service swift] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:15.591187 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6ac62-9d0d-4ff5-89a3-c23e474726a1 service swift] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:15.596621 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dea09-74cc-4044-89fb-4e927ecd3866 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:15.597286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dea09-74cc-4044-89fb-4e927ecd3866 service swift] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:15.597605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dea09-74cc-4044-89fb-4e927ecd3866 service swift] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:15.597888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dea09-74cc-4044-89fb-4e927ecd3866 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:15.605927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294dea09-74cc-4044-89fb-4e927ecd3866 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:15.607529 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294dea09-74cc-4044-89fb-4e927ecd3866 service swift] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:15.615871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1277/2563] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:56:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:56:15.923609 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e7168-ca8b-4738-a3bb-b9f552e952f0 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:15.923987 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e7168-ca8b-4738-a3bb-b9f552e952f0 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:15.924263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e7168-ca8b-4738-a3bb-b9f552e952f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:15.942512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-c67e7168-ca8b-4738-a3bb-b9f552e952f0 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:56:15.943723 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c67e7168-ca8b-4738-a3bb-b9f552e952f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:15.950740 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1287/2564] 10.222.0.117 () {58 vars in 972 bytes} [Mon Jan 24 16:56:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:56:15.962769 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dea09-74cc-4044-89fb-4e927ecd3866 service swift] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:15.973185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dea09-74cc-4044-89fb-4e927ecd3866 service swift] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:15.978150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb34ca-0c5c-4ad1-acf9-4997ae715ec5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:15.978795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb34ca-0c5c-4ad1-acf9-4997ae715ec5 service swift] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:15.979078 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb34ca-0c5c-4ad1-acf9-4997ae715ec5 service swift] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:15.979347 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb34ca-0c5c-4ad1-acf9-4997ae715ec5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:15.987789 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb34ca-0c5c-4ad1-acf9-4997ae715ec5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:15.989341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb34ca-0c5c-4ad1-acf9-4997ae715ec5 service swift] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:15.996983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1278/2565] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:56:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:56:17.992880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e7168-ca8b-4738-a3bb-b9f552e952f0 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:18.055091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e7168-ca8b-4738-a3bb-b9f552e952f0 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:18.060156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:18.061013 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:18.061296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:18.061573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] PATH_INFO: `/v3/users/948d485ebe0946079cf64cdac3312126` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:18.062796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948d485ebe0946079cf64cdac3312126)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:18.065227 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:18.117974 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948d485ebe0946079cf64cdac3312126'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:18.129646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948d485ebe0946079cf64cdac3312126'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:18.130319 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948d485ebe0946079cf64cdac3312126'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:18.130952 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948d485ebe0946079cf64cdac3312126'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:18.142360 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948d485ebe0946079cf64cdac3312126'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:18.154333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1288/2566] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:56:17 2022] DELETE /identity/v3/users/948d485ebe0946079cf64cdac3312126 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:56:18.159640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f88ac-813e-438f-a5ee-702830a6fb16 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:18.160041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f88ac-813e-438f-a5ee-702830a6fb16 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:18.160221 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f88ac-813e-438f-a5ee-702830a6fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:18.177808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-c78f88ac-813e-438f-a5ee-702830a6fb16 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:56:18.179030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c78f88ac-813e-438f-a5ee-702830a6fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:18.238226 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1279/2567] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:56:18.247541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:18.248947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:18.307902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247bec2-57f2-4cf7-924c-58813084dcf5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:18.311750 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa5336-b079-4230-9810-71109aef733b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:18.312403 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa5336-b079-4230-9810-71109aef733b service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:18.312736 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa5336-b079-4230-9810-71109aef733b service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:18.313016 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa5336-b079-4230-9810-71109aef733b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:18.322267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa5336-b079-4230-9810-71109aef733b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:18.323728 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa5336-b079-4230-9810-71109aef733b service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:18.333769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1289/2568] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:56:18.508434 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f88ac-813e-438f-a5ee-702830a6fb16 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:18.510137 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-c78f88ac-813e-438f-a5ee-702830a6fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:18.533632 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f88ac-813e-438f-a5ee-702830a6fb16 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:18.540712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:18.542875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:18.543361 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:18.543845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] PATH_INFO: `/v3/projects/91c6a4a7b6294557aa79bfcd9fae3cb3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:18.545488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c6a4a7b6294557aa79bfcd9fae3cb3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:18.548380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:18.606416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'request_id': 'req-f8fd7eb4-f53b-4e58-b341-ede453ee6665'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:18.616476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'request_id': 'req-f8fd7eb4-f53b-4e58-b341-ede453ee6665'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:18.627895 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'request_id': 'req-f8fd7eb4-f53b-4e58-b341-ede453ee6665'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:18.638661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] The token cache is being invalidate because project 91c6a4a7b6294557aa79bfcd9fae3cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:56:18.638984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:18.639655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:18.641184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1280/2569] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:56:18 2022] DELETE /identity/v3/projects/91c6a4a7b6294557aa79bfcd9fae3cb3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:56:25.040429 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa5336-b079-4230-9810-71109aef733b service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:25.041886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-18aa5336-b079-4230-9810-71109aef733b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:25.053612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa5336-b079-4230-9810-71109aef733b service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:25.102349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd1741-57ab-4ae6-a974-298a2d12a62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:25.103028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd1741-57ab-4ae6-a974-298a2d12a62e service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:25.103311 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd1741-57ab-4ae6-a974-298a2d12a62e service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:25.103583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd1741-57ab-4ae6-a974-298a2d12a62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:25.105338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-68cd1741-57ab-4ae6-a974-298a2d12a62e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:25.167256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd1741-57ab-4ae6-a974-298a2d12a62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:25.168660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd1741-57ab-4ae6-a974-298a2d12a62e service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:25.179455 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1290/2570] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:56:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:56:25.240674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:25.242096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:25.308725 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd7eb4-f53b-4e58-b341-ede453ee6665 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:25.312494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad638494-a178-4c39-87f0-e8291ef4f97a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:25.313240 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638494-a178-4c39-87f0-e8291ef4f97a service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:25.313524 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638494-a178-4c39-87f0-e8291ef4f97a service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:25.313804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638494-a178-4c39-87f0-e8291ef4f97a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:25.315803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ad638494-a178-4c39-87f0-e8291ef4f97a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:25.385724 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad638494-a178-4c39-87f0-e8291ef4f97a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:25.387217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad638494-a178-4c39-87f0-e8291ef4f97a service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:25.396779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1281/2571] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:56:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:56:27.735955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed3827-96a4-4d84-b4f5-f585c9b46c74 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:27.736741 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed3827-96a4-4d84-b4f5-f585c9b46c74 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:27.737166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed3827-96a4-4d84-b4f5-f585c9b46c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:27.758272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-78ed3827-96a4-4d84-b4f5-f585c9b46c74 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:56:27.759979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-78ed3827-96a4-4d84-b4f5-f585c9b46c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:27.837690 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1291/2572] 10.222.0.117 () {58 vars in 972 bytes} [Mon Jan 24 16:56:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:56:27.852516 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad638494-a178-4c39-87f0-e8291ef4f97a service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:27.854672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-ad638494-a178-4c39-87f0-e8291ef4f97a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:27.939551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad638494-a178-4c39-87f0-e8291ef4f97a service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:27.945737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901f503-9a0d-43d6-9820-4b778e0f5f12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:27.946658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901f503-9a0d-43d6-9820-4b778e0f5f12 service swift] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:27.947179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901f503-9a0d-43d6-9820-4b778e0f5f12 service swift] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:27.947661 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901f503-9a0d-43d6-9820-4b778e0f5f12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:27.958412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901f503-9a0d-43d6-9820-4b778e0f5f12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:27.960386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901f503-9a0d-43d6-9820-4b778e0f5f12 service swift] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:27.971309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1282/2573] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:56:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:56:28.031785 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed3827-96a4-4d84-b4f5-f585c9b46c74 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:28.033249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-78ed3827-96a4-4d84-b4f5-f585c9b46c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:28.054937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed3827-96a4-4d84-b4f5-f585c9b46c74 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:28.067155 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2e598-4824-4363-85ba-655116b2feba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:28.067841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e598-4824-4363-85ba-655116b2feba service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:28.068251 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e598-4824-4363-85ba-655116b2feba service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:28.068530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e598-4824-4363-85ba-655116b2feba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:28.078649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a2b2e598-4824-4363-85ba-655116b2feba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:28.281896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2e598-4824-4363-85ba-655116b2feba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:28.284870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2e598-4824-4363-85ba-655116b2feba service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:28.336000 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1292/2574] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:56:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:56:33.060342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d43c-24bb-48ec-bc74-f362e77b9d65 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:33.060926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d43c-24bb-48ec-bc74-f362e77b9d65 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:33.060926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d43c-24bb-48ec-bc74-f362e77b9d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:33.081389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-de12d43c-24bb-48ec-bc74-f362e77b9d65 None None] MFA Rules not processed for user `edb10d68444a4c6e947c1e356987736f`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:56:33.082733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-de12d43c-24bb-48ec-bc74-f362e77b9d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:33.090522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1283/2575] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:56:33.406839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2e598-4824-4363-85ba-655116b2feba service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:33.408304 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a2b2e598-4824-4363-85ba-655116b2feba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:33.419452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2e598-4824-4363-85ba-655116b2feba service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:33.423910 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43279b65-481b-4973-8299-a022bf387c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:33.424561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43279b65-481b-4973-8299-a022bf387c61 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:33.424849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43279b65-481b-4973-8299-a022bf387c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:33.425119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43279b65-481b-4973-8299-a022bf387c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:33.427396 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-43279b65-481b-4973-8299-a022bf387c61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:33.437943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43279b65-481b-4973-8299-a022bf387c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:33.439398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43279b65-481b-4973-8299-a022bf387c61 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:33.447514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1293/2576] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:56:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:56:37.149310 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12d43c-24bb-48ec-bc74-f362e77b9d65 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:37.151708 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-de12d43c-24bb-48ec-bc74-f362e77b9d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:37.233506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12d43c-24bb-48ec-bc74-f362e77b9d65 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:37.239321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:37.240274 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:37.240553 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:37.240891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] PATH_INFO: `/v3/users/d07e0cd23d0c4f2ab7aba38a564dc693` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:37.242265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07e0cd23d0c4f2ab7aba38a564dc693)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:37.244499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:37.300420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07e0cd23d0c4f2ab7aba38a564dc693'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.308254 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07e0cd23d0c4f2ab7aba38a564dc693'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.315704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07e0cd23d0c4f2ab7aba38a564dc693'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.329897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07e0cd23d0c4f2ab7aba38a564dc693'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.330635 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07e0cd23d0c4f2ab7aba38a564dc693'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.337090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1284/2577] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:56:37 2022] DELETE /identity/v3/users/d07e0cd23d0c4f2ab7aba38a564dc693 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:56:37.526712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43279b65-481b-4973-8299-a022bf387c61 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:37.544846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43279b65-481b-4973-8299-a022bf387c61 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:37.621153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:37.622020 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:37.622304 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:37.622575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] PATH_INFO: `/v3/projects/d60ca23ca0784aef8638d92cfdca914f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:37.623835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60ca23ca0784aef8638d92cfdca914f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:37.626567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:37.684150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60ca23ca0784aef8638d92cfdca914f', 'request_id': 'req-3bb40be1-7754-41cb-ac88-c1da592a732a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.689713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60ca23ca0784aef8638d92cfdca914f', 'request_id': 'req-3bb40be1-7754-41cb-ac88-c1da592a732a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.698430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60ca23ca0784aef8638d92cfdca914f', 'request_id': 'req-3bb40be1-7754-41cb-ac88-c1da592a732a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.711831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] The token cache is being invalidate because project d60ca23ca0784aef8638d92cfdca914f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:56:37.712190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.713212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.718632 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1294/2578] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:56:37 2022] DELETE /identity/v3/projects/d60ca23ca0784aef8638d92cfdca914f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:56:37.719727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:37.721456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:37.746932 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4554e1-e892-4689-bc0a-0733e11e228c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:37.855111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5375e4a-7793-4f03-8eb9-21958cc44b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:37.855992 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5375e4a-7793-4f03-8eb9-21958cc44b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:37.856276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5375e4a-7793-4f03-8eb9-21958cc44b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:37.856555 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5375e4a-7793-4f03-8eb9-21958cc44b89 admin admin] PATH_INFO: `/v3/users/7f2e905603904018aa70fc922c0a16ed` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:37.857795 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5375e4a-7793-4f03-8eb9-21958cc44b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2e905603904018aa70fc922c0a16ed)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:37.860697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5375e4a-7793-4f03-8eb9-21958cc44b89 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:37.922314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c5375e4a-7793-4f03-8eb9-21958cc44b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2e905603904018aa70fc922c0a16ed'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.932082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c5375e4a-7793-4f03-8eb9-21958cc44b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2e905603904018aa70fc922c0a16ed'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.942846 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c5375e4a-7793-4f03-8eb9-21958cc44b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2e905603904018aa70fc922c0a16ed'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.956170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c5375e4a-7793-4f03-8eb9-21958cc44b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2e905603904018aa70fc922c0a16ed'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.956960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c5375e4a-7793-4f03-8eb9-21958cc44b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2e905603904018aa70fc922c0a16ed'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:37.963250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1285/2579] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:56:37 2022] DELETE /identity/v3/users/7f2e905603904018aa70fc922c0a16ed => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:56:38.150733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:56:38.152303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:56:38.166459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb40be1-7754-41cb-ac88-c1da592a732a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:56:38.226944 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:56:38.227815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:56:38.228102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:56:38.228382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] PATH_INFO: `/v3/projects/280da8b789a04062997d0c9bd25e86e2` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:56:38.229658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=280da8b789a04062997d0c9bd25e86e2)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:56:38.231606 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:56:38.280116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280da8b789a04062997d0c9bd25e86e2', 'request_id': 'req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:38.286331 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280da8b789a04062997d0c9bd25e86e2', 'request_id': 'req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:38.294170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280da8b789a04062997d0c9bd25e86e2', 'request_id': 'req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:38.309603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] The token cache is being invalidate because project 280da8b789a04062997d0c9bd25e86e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:56:38.309898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:38.311083 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:56:38.314466 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1295/2580] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:56:38 2022] DELETE /identity/v3/projects/280da8b789a04062997d0c9bd25e86e2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:57:16.055511 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f7426-6898-48af-8987-179834bc9548 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:16.056014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f7426-6898-48af-8987-179834bc9548 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:16.056117 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f7426-6898-48af-8987-179834bc9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:16.075338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-426f7426-6898-48af-8987-179834bc9548 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:57:16.076738 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-426f7426-6898-48af-8987-179834bc9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:57:16.129883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1286/2581] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:57:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:57:16.152623 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:57:16.154302 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:57:16.231917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f9f00-15b4-4c18-84fe-430c9e87fbd4 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:57:16.236904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27acee7-d95f-4a8a-accc-2291ba4e178d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:57:16.237547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27acee7-d95f-4a8a-accc-2291ba4e178d service swift] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:16.237833 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27acee7-d95f-4a8a-accc-2291ba4e178d service swift] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:16.238111 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27acee7-d95f-4a8a-accc-2291ba4e178d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:16.246065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27acee7-d95f-4a8a-accc-2291ba4e178d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:57:16.247839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27acee7-d95f-4a8a-accc-2291ba4e178d service swift] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:57:16.255631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1296/2582] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:57:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 24 16:57:29.648597 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470ab9-5242-4c72-a535-5093d17e7723 None None] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:29.649104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470ab9-5242-4c72-a535-5093d17e7723 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:29.649215 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470ab9-5242-4c72-a535-5093d17e7723 None None] PATH_INFO: `/` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:29.650953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1287/2583] 10.222.0.117 () {54 vars in 926 bytes} [Mon Jan 24 16:57:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:57:29.658142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d03f14-318a-45db-b2ed-b7f7cd6c88fd None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:29.658623 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d03f14-318a-45db-b2ed-b7f7cd6c88fd None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:29.658722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d03f14-318a-45db-b2ed-b7f7cd6c88fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:29.676713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-13d03f14-318a-45db-b2ed-b7f7cd6c88fd None None] MFA Rules not processed for user `37c91fefe89a45b48df82a311e771ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:57:29.677924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-13d03f14-318a-45db-b2ed-b7f7cd6c88fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:57:29.745827 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1297/2584] 10.222.0.117 () {58 vars in 1023 bytes} [Mon Jan 24 16:57:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:57:29.757768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f470ab9-5242-4c72-a535-5093d17e7723 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:57:29.761750 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5f470ab9-5242-4c72-a535-5093d17e7723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:57:29.818666 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f470ab9-5242-4c72-a535-5093d17e7723 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:57:29.822321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a6329-c592-4ac8-a450-a847743a57ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2691f7bb4ed84de4bb5901710a96d766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:57:29.823001 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a6329-c592-4ac8-a450-a847743a57ba service glance] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:29.823943 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a6329-c592-4ac8-a450-a847743a57ba service glance] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:29.824231 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a6329-c592-4ac8-a450-a847743a57ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:29.834014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a6329-c592-4ac8-a450-a847743a57ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:57:29.835492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a6329-c592-4ac8-a450-a847743a57ba service glance] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:57:29.846068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1288/2585] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:57:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:57:29.912682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebc227-0b4b-4f2a-9fde-6df531a16872 None None] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:29.912998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebc227-0b4b-4f2a-9fde-6df531a16872 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:29.913279 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebc227-0b4b-4f2a-9fde-6df531a16872 None None] PATH_INFO: `/` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:29.915207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1298/2586] 10.222.0.117 () {54 vars in 926 bytes} [Mon Jan 24 16:57:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 24 16:57:29.920038 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816db21-4f73-453b-a39e-c1e98b562a88 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:29.920323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816db21-4f73-453b-a39e-c1e98b562a88 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:29.920600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816db21-4f73-453b-a39e-c1e98b562a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:29.939590 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a816db21-4f73-453b-a39e-c1e98b562a88 None None] MFA Rules not processed for user `aa9834b75e2b4ac787f3917564090d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:57:29.941045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a816db21-4f73-453b-a39e-c1e98b562a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:57:30.004172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1289/2587] 10.222.0.117 () {58 vars in 1023 bytes} [Mon Jan 24 16:57:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:57:30.015765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebc227-0b4b-4f2a-9fde-6df531a16872 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:57:30.017504 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-70ebc227-0b4b-4f2a-9fde-6df531a16872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:57:30.031161 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebc227-0b4b-4f2a-9fde-6df531a16872 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:57:30.034656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c7584-bfab-4c92-851a-bd94c1ab012e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:57:30.035314 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7584-bfab-4c92-851a-bd94c1ab012e service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:30.035600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7584-bfab-4c92-851a-bd94c1ab012e service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:30.035881 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7584-bfab-4c92-851a-bd94c1ab012e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:30.043702 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c7584-bfab-4c92-851a-bd94c1ab012e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:57:30.045147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c7584-bfab-4c92-851a-bd94c1ab012e service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:57:30.053081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1299/2588] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:57:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:57:31.624236 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e72c-9844-42c8-933f-855bdf6a6b7b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:31.624695 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e72c-9844-42c8-933f-855bdf6a6b7b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:31.624810 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e72c-9844-42c8-933f-855bdf6a6b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:31.642667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-4933e72c-9844-42c8-933f-855bdf6a6b7b None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:57:31.643897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-4933e72c-9844-42c8-933f-855bdf6a6b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:57:31.650973 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1290/2589] 10.222.0.117 () {58 vars in 1014 bytes} [Mon Jan 24 16:57:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:57:31.663321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c7584-bfab-4c92-851a-bd94c1ab012e service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:57:31.675743 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c7584-bfab-4c92-851a-bd94c1ab012e service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:57:31.680670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b6638-fbaf-4d5f-9922-67031064662b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:57:31.681328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b6638-fbaf-4d5f-9922-67031064662b service swift] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:31.681809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b6638-fbaf-4d5f-9922-67031064662b service swift] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:31.682327 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b6638-fbaf-4d5f-9922-67031064662b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:31.691653 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b6638-fbaf-4d5f-9922-67031064662b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:57:31.693242 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b6638-fbaf-4d5f-9922-67031064662b service swift] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:57:31.701681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1300/2590] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:57:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:57:45.728253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047438f7-543c-41a3-bf73-eab7d6df2896 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:45.729296 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047438f7-543c-41a3-bf73-eab7d6df2896 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:45.729296 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047438f7-543c-41a3-bf73-eab7d6df2896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:45.747088 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-047438f7-543c-41a3-bf73-eab7d6df2896 None None] MFA Rules not processed for user `3d89f63c0db746008b7d9da99bd30266`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:57:45.748365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-047438f7-543c-41a3-bf73-eab7d6df2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:57:45.755535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1291/2591] 10.222.0.117 () {58 vars in 972 bytes} [Mon Jan 24 16:57:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:57:45.767780 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b6638-fbaf-4d5f-9922-67031064662b service swift] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:57:45.778928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b6638-fbaf-4d5f-9922-67031064662b service swift] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:57:45.784469 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc09cb3-31f0-4848-a0e1-8e40efc9f8d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6d64d2408e481db883823e98f4d831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:57:45.784850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc09cb3-31f0-4848-a0e1-8e40efc9f8d7 service swift] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:57:45.785139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc09cb3-31f0-4848-a0e1-8e40efc9f8d7 service swift] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:57:45.785412 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc09cb3-31f0-4848-a0e1-8e40efc9f8d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:57:45.795858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc09cb3-31f0-4848-a0e1-8e40efc9f8d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:57:45.797771 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc09cb3-31f0-4848-a0e1-8e40efc9f8d7 service swift] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:57:45.806812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1301/2592] 10.222.0.117 () {60 vars in 1389 bytes} [Mon Jan 24 16:57:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 24 16:58:11.216125 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047438f7-543c-41a3-bf73-eab7d6df2896 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:11.217551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-047438f7-543c-41a3-bf73-eab7d6df2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:11.230287 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047438f7-543c-41a3-bf73-eab7d6df2896 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:11.233850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb7fc2-81ce-4421-a9cc-7fe92519d83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:11.234487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb7fc2-81ce-4421-a9cc-7fe92519d83d service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:11.234796 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb7fc2-81ce-4421-a9cc-7fe92519d83d service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:11.235080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb7fc2-81ce-4421-a9cc-7fe92519d83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:11.236851 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1beb7fc2-81ce-4421-a9cc-7fe92519d83d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:11.303599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb7fc2-81ce-4421-a9cc-7fe92519d83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:11.306818 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb7fc2-81ce-4421-a9cc-7fe92519d83d service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:11.317136 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1292/2593] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:58:14.559492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc09cb3-31f0-4848-a0e1-8e40efc9f8d7 service swift] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:14.561002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-bbc09cb3-31f0-4848-a0e1-8e40efc9f8d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:14.574625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc09cb3-31f0-4848-a0e1-8e40efc9f8d7 service swift] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:14.579224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f55c0-2917-4800-9053-5fda9f181808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:14.580029 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f55c0-2917-4800-9053-5fda9f181808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:14.580313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f55c0-2917-4800-9053-5fda9f181808 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:14.580598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f55c0-2917-4800-9053-5fda9f181808 admin admin] PATH_INFO: `/v3/users/edb10d68444a4c6e947c1e356987736f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:14.581812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f55c0-2917-4800-9053-5fda9f181808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb10d68444a4c6e947c1e356987736f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:14.583758 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f55c0-2917-4800-9053-5fda9f181808 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:14.630117 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-d48f55c0-2917-4800-9053-5fda9f181808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb10d68444a4c6e947c1e356987736f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:14.641834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-d48f55c0-2917-4800-9053-5fda9f181808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb10d68444a4c6e947c1e356987736f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:14.642500 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-d48f55c0-2917-4800-9053-5fda9f181808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb10d68444a4c6e947c1e356987736f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:14.643132 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-d48f55c0-2917-4800-9053-5fda9f181808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb10d68444a4c6e947c1e356987736f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:14.651043 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-d48f55c0-2917-4800-9053-5fda9f181808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb10d68444a4c6e947c1e356987736f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:14.662727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1302/2594] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:14 2022] DELETE /identity/v3/users/edb10d68444a4c6e947c1e356987736f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:14.833899 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb7fc2-81ce-4421-a9cc-7fe92519d83d service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:14.844994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb7fc2-81ce-4421-a9cc-7fe92519d83d service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:14.900087 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:14.900939 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:14.901224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:14.901503 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] PATH_INFO: `/v3/projects/24a57596de944ff6b3c322128a836000` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:14.902708 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a57596de944ff6b3c322128a836000)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:14.904632 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:14.950055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a57596de944ff6b3c322128a836000', 'request_id': 'req-c080a392-1511-4139-8fa1-012b1f9c01d7'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:14.956894 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a57596de944ff6b3c322128a836000', 'request_id': 'req-c080a392-1511-4139-8fa1-012b1f9c01d7'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:14.963847 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a57596de944ff6b3c322128a836000', 'request_id': 'req-c080a392-1511-4139-8fa1-012b1f9c01d7'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:14.973730 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] The token cache is being invalidate because project 24a57596de944ff6b3c322128a836000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:14.974017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:14.974646 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c080a392-1511-4139-8fa1-012b1f9c01d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:14.976189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1293/2595] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:14 2022] DELETE /identity/v3/projects/24a57596de944ff6b3c322128a836000 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:14.982118 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7dcfe-aa2e-4c12-b18f-75818d7a44fe None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:14.982406 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7dcfe-aa2e-4c12-b18f-75818d7a44fe None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:14.982680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7dcfe-aa2e-4c12-b18f-75818d7a44fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.002704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-72e7dcfe-aa2e-4c12-b18f-75818d7a44fe None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:15.004998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-72e7dcfe-aa2e-4c12-b18f-75818d7a44fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:15.068966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1303/2596] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:15.077639 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ba7fd-b630-4c7b-a76c-e21a2cee2d3b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.077924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ba7fd-b630-4c7b-a76c-e21a2cee2d3b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.078211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ba7fd-b630-4c7b-a76c-e21a2cee2d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.099480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-0e3ba7fd-b630-4c7b-a76c-e21a2cee2d3b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:15.100598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0e3ba7fd-b630-4c7b-a76c-e21a2cee2d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:15.108967 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1294/2597] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:15.113239 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7dcfe-aa2e-4c12-b18f-75818d7a44fe None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.123603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7dcfe-aa2e-4c12-b18f-75818d7a44fe None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.128224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd1a30-6f2f-4c8b-92a7-2d38199a27d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.128896 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd1a30-6f2f-4c8b-92a7-2d38199a27d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.129184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd1a30-6f2f-4c8b-92a7-2d38199a27d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.129459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd1a30-6f2f-4c8b-92a7-2d38199a27d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.130192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd1a30-6f2f-4c8b-92a7-2d38199a27d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:58:15.130496 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd1a30-6f2f-4c8b-92a7-2d38199a27d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.132167 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd1a30-6f2f-4c8b-92a7-2d38199a27d5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.144569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1304/2598] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:58:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:58:15.149380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ba7fd-b630-4c7b-a76c-e21a2cee2d3b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.158544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ba7fd-b630-4c7b-a76c-e21a2cee2d3b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.163206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1163cb-cd22-47a4-a258-3c572092a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.163852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1163cb-cd22-47a4-a258-3c572092a80c admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.164132 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1163cb-cd22-47a4-a258-3c572092a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.164985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1163cb-cd22-47a4-a258-3c572092a80c admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.165710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1163cb-cd22-47a4-a258-3c572092a80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.167627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1163cb-cd22-47a4-a258-3c572092a80c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.202697 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1295/2599] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:15 2022] POST /identity/v3/projects => generated 372 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:58:15.206979 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd1a30-6f2f-4c8b-92a7-2d38199a27d5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.217608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd1a30-6f2f-4c8b-92a7-2d38199a27d5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.272533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802a3d4-84e2-488d-ba9b-e6f3bd1aef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.273188 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802a3d4-84e2-488d-ba9b-e6f3bd1aef7b admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.273914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802a3d4-84e2-488d-ba9b-e6f3bd1aef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.274203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802a3d4-84e2-488d-ba9b-e6f3bd1aef7b admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.274933 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802a3d4-84e2-488d-ba9b-e6f3bd1aef7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.276813 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802a3d4-84e2-488d-ba9b-e6f3bd1aef7b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.296142 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1305/2600] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:15 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:15.300401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1163cb-cd22-47a4-a258-3c572092a80c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.312669 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1163cb-cd22-47a4-a258-3c572092a80c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.317374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fecc7-e190-469a-bd60-2ac2203b8e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.318053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fecc7-e190-469a-bd60-2ac2203b8e45 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.318330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fecc7-e190-469a-bd60-2ac2203b8e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.318601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fecc7-e190-469a-bd60-2ac2203b8e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.319380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fecc7-e190-469a-bd60-2ac2203b8e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.321631 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fecc7-e190-469a-bd60-2ac2203b8e45 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.331469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1296/2601] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:15 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:58:15.335521 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802a3d4-84e2-488d-ba9b-e6f3bd1aef7b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.345350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802a3d4-84e2-488d-ba9b-e6f3bd1aef7b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.350053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b6a2-bc86-4b51-b1ef-5d63092c69bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.350671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b6a2-bc86-4b51-b1ef-5d63092c69bf admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.350991 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b6a2-bc86-4b51-b1ef-5d63092c69bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.351272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b6a2-bc86-4b51-b1ef-5d63092c69bf admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.352187 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4b6a2-bc86-4b51-b1ef-5d63092c69bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.353778 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4b6a2-bc86-4b51-b1ef-5d63092c69bf admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.363383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1306/2602] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:15 2022] GET /identity/v3/roles => generated 1427 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:15.367983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fecc7-e190-469a-bd60-2ac2203b8e45 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.377654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fecc7-e190-469a-bd60-2ac2203b8e45 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.382311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d650990-00d2-45f8-9b30-30641a0ab5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.383762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d650990-00d2-45f8-9b30-30641a0ab5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.384148 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d650990-00d2-45f8-9b30-30641a0ab5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.384580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d650990-00d2-45f8-9b30-30641a0ab5d0 admin admin] PATH_INFO: `/v3/projects/2dc3363c56f542a9a24568117c4ebc02/users/98d5e1bab24842a695cb1ed8b130bba9/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.399143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d650990-00d2-45f8-9b30-30641a0ab5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc3363c56f542a9a24568117c4ebc02, user_id=98d5e1bab24842a695cb1ed8b130bba9, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.401799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d650990-00d2-45f8-9b30-30641a0ab5d0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.414065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1297/2603] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:15 2022] PUT /identity/v3/projects/2dc3363c56f542a9a24568117c4ebc02/users/98d5e1bab24842a695cb1ed8b130bba9/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:58:15.425041 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956552ce-6c68-4bd1-9401-3bafe212a7ec None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.425358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956552ce-6c68-4bd1-9401-3bafe212a7ec None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.425647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956552ce-6c68-4bd1-9401-3bafe212a7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.454156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-956552ce-6c68-4bd1-9401-3bafe212a7ec None None] MFA Rules not processed for user `98d5e1bab24842a695cb1ed8b130bba9`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:15.455475 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-956552ce-6c68-4bd1-9401-3bafe212a7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:15.521735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1307/2604] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:58:15.526441 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d650990-00d2-45f8-9b30-30641a0ab5d0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.586575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d650990-00d2-45f8-9b30-30641a0ab5d0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.591137 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945af5b5-4380-4de4-b260-9cac56b8bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.591779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945af5b5-4380-4de4-b260-9cac56b8bd1e admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.592053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945af5b5-4380-4de4-b260-9cac56b8bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.592351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945af5b5-4380-4de4-b260-9cac56b8bd1e admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.593055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945af5b5-4380-4de4-b260-9cac56b8bd1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.594954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945af5b5-4380-4de4-b260-9cac56b8bd1e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.619598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1298/2605] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:15 2022] POST /identity/v3/projects => generated 372 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:15.623450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956552ce-6c68-4bd1-9401-3bafe212a7ec None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.633963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956552ce-6c68-4bd1-9401-3bafe212a7ec None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.688176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48caf9-e8c0-4c04-b3cf-ec3c61b1d3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.688824 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48caf9-e8c0-4c04-b3cf-ec3c61b1d3ff admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.689235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48caf9-e8c0-4c04-b3cf-ec3c61b1d3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.689513 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48caf9-e8c0-4c04-b3cf-ec3c61b1d3ff admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.690207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48caf9-e8c0-4c04-b3cf-ec3c61b1d3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.692113 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48caf9-e8c0-4c04-b3cf-ec3c61b1d3ff admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.711175 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1308/2606] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:15 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:15.715213 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945af5b5-4380-4de4-b260-9cac56b8bd1e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.725155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945af5b5-4380-4de4-b260-9cac56b8bd1e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.730525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13763024-c366-4400-8dc1-c34a3900d316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.731210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13763024-c366-4400-8dc1-c34a3900d316 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.731491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13763024-c366-4400-8dc1-c34a3900d316 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.731768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13763024-c366-4400-8dc1-c34a3900d316 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.732571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13763024-c366-4400-8dc1-c34a3900d316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.734315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13763024-c366-4400-8dc1-c34a3900d316 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.745208 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1299/2607] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:15 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:15.749205 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48caf9-e8c0-4c04-b3cf-ec3c61b1d3ff admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.759745 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48caf9-e8c0-4c04-b3cf-ec3c61b1d3ff admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.764453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db544fb-c341-43ee-8cf7-5eded5d336f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.765352 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db544fb-c341-43ee-8cf7-5eded5d336f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.765636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db544fb-c341-43ee-8cf7-5eded5d336f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.765914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db544fb-c341-43ee-8cf7-5eded5d336f3 admin admin] PATH_INFO: `/v3/projects/8f174819dbaf44b3bae04bd123dfe9de/users/3976d0698b2d41b788284e74f553be42/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.788796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db544fb-c341-43ee-8cf7-5eded5d336f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f174819dbaf44b3bae04bd123dfe9de, user_id=3976d0698b2d41b788284e74f553be42, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.792192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db544fb-c341-43ee-8cf7-5eded5d336f3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.806435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1309/2608] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:15 2022] PUT /identity/v3/projects/8f174819dbaf44b3bae04bd123dfe9de/users/3976d0698b2d41b788284e74f553be42/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:58:15.810421 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13763024-c366-4400-8dc1-c34a3900d316 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.822092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13763024-c366-4400-8dc1-c34a3900d316 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.880956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b8e79-1799-4b84-9cfb-441c7d1300b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.881576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8e79-1799-4b84-9cfb-441c7d1300b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.881816 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8e79-1799-4b84-9cfb-441c7d1300b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.882094 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8e79-1799-4b84-9cfb-441c7d1300b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.883005 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b8e79-1799-4b84-9cfb-441c7d1300b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.885086 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b8e79-1799-4b84-9cfb-441c7d1300b0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.896006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1300/2609] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:15 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:15.900874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db544fb-c341-43ee-8cf7-5eded5d336f3 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:15.911187 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db544fb-c341-43ee-8cf7-5eded5d336f3 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:15.916818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15095-dc7b-4f89-9cfb-9ea8edf6cb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:15.917720 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15095-dc7b-4f89-9cfb-9ea8edf6cb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.917997 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15095-dc7b-4f89-9cfb-9ea8edf6cb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.918267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15095-dc7b-4f89-9cfb-9ea8edf6cb8d admin admin] PATH_INFO: `/v3/projects/8f174819dbaf44b3bae04bd123dfe9de/users/3976d0698b2d41b788284e74f553be42/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.920276 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc15095-dc7b-4f89-9cfb-9ea8edf6cb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f174819dbaf44b3bae04bd123dfe9de, user_id=3976d0698b2d41b788284e74f553be42, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:15.923178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc15095-dc7b-4f89-9cfb-9ea8edf6cb8d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:15.934227 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1310/2610] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:15 2022] PUT /identity/v3/projects/8f174819dbaf44b3bae04bd123dfe9de/users/3976d0698b2d41b788284e74f553be42/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:15.946608 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caeff3-33bf-4769-aee5-afc81a1825d0 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:15.946974 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caeff3-33bf-4769-aee5-afc81a1825d0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:15.947256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caeff3-33bf-4769-aee5-afc81a1825d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:15.973852 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-71caeff3-33bf-4769-aee5-afc81a1825d0 None None] MFA Rules not processed for user `3976d0698b2d41b788284e74f553be42`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:15.975071 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-71caeff3-33bf-4769-aee5-afc81a1825d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:16.046301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1301/2611] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:16.056686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15095-dc7b-4f89-9cfb-9ea8edf6cb8d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:16.058462 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1bc15095-dc7b-4f89-9cfb-9ea8edf6cb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:16.115811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15095-dc7b-4f89-9cfb-9ea8edf6cb8d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:16.120188 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4565e7-70bd-464f-bd8d-5a4ea6d6a1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:16.120849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4565e7-70bd-464f-bd8d-5a4ea6d6a1fe service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:16.121143 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4565e7-70bd-464f-bd8d-5a4ea6d6a1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:16.121410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4565e7-70bd-464f-bd8d-5a4ea6d6a1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:16.132275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4565e7-70bd-464f-bd8d-5a4ea6d6a1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:16.134256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4565e7-70bd-464f-bd8d-5a4ea6d6a1fe service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:16.144357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1311/2612] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:16.214607 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caeff3-33bf-4769-aee5-afc81a1825d0 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:16.224322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caeff3-33bf-4769-aee5-afc81a1825d0 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:16.228502 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63868a-65ef-4ebb-832d-84a3e32000ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:16.229172 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63868a-65ef-4ebb-832d-84a3e32000ca service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:16.229456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63868a-65ef-4ebb-832d-84a3e32000ca service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:16.229734 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63868a-65ef-4ebb-832d-84a3e32000ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:16.284392 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63868a-65ef-4ebb-832d-84a3e32000ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:16.285818 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63868a-65ef-4ebb-832d-84a3e32000ca service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:16.294942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1302/2613] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:28.970494 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4565e7-70bd-464f-bd8d-5a4ea6d6a1fe service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:28.972093 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-0f4565e7-70bd-464f-bd8d-5a4ea6d6a1fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:29.027264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4565e7-70bd-464f-bd8d-5a4ea6d6a1fe service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:29.031023 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a7852-259c-4a06-93d5-4cd7bc6b68ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:29.031654 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a7852-259c-4a06-93d5-4cd7bc6b68ca service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:29.031934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a7852-259c-4a06-93d5-4cd7bc6b68ca service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:29.032209 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a7852-259c-4a06-93d5-4cd7bc6b68ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:29.034028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7b9a7852-259c-4a06-93d5-4cd7bc6b68ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:29.100150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a7852-259c-4a06-93d5-4cd7bc6b68ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:29.101672 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a7852-259c-4a06-93d5-4cd7bc6b68ca service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:29.111425 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1312/2614] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:32.671836 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63868a-65ef-4ebb-832d-84a3e32000ca service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:32.673342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0f63868a-65ef-4ebb-832d-84a3e32000ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:32.688318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63868a-65ef-4ebb-832d-84a3e32000ca service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:32.693116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66620fe6-c95c-4971-b534-9950d1d9b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:32.694189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66620fe6-c95c-4971-b534-9950d1d9b26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:32.694458 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66620fe6-c95c-4971-b534-9950d1d9b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:32.694558 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66620fe6-c95c-4971-b534-9950d1d9b26c admin admin] PATH_INFO: `/v3/users/50e012c5fcde4462984a57878629fd6f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:32.695790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66620fe6-c95c-4971-b534-9950d1d9b26c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e012c5fcde4462984a57878629fd6f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:32.697771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66620fe6-c95c-4971-b534-9950d1d9b26c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:32.742981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-66620fe6-c95c-4971-b534-9950d1d9b26c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e012c5fcde4462984a57878629fd6f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:32.750323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-66620fe6-c95c-4971-b534-9950d1d9b26c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e012c5fcde4462984a57878629fd6f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:32.757950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-66620fe6-c95c-4971-b534-9950d1d9b26c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e012c5fcde4462984a57878629fd6f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:32.769309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-66620fe6-c95c-4971-b534-9950d1d9b26c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e012c5fcde4462984a57878629fd6f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:32.769982 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-66620fe6-c95c-4971-b534-9950d1d9b26c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e012c5fcde4462984a57878629fd6f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:32.776583 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1303/2615] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:32 2022] DELETE /identity/v3/users/50e012c5fcde4462984a57878629fd6f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:32.945694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a7852-259c-4a06-93d5-4cd7bc6b68ca service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:32.957603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a7852-259c-4a06-93d5-4cd7bc6b68ca service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:33.017124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:33.018066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.018499 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.018874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] PATH_INFO: `/v3/projects/5ca1c94bee974fb986196c0be4064812` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.024231 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca1c94bee974fb986196c0be4064812)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:33.026213 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:33.073894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca1c94bee974fb986196c0be4064812', 'request_id': 'req-55294108-4c46-4925-9430-1fab12b2ed60'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:33.079363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca1c94bee974fb986196c0be4064812', 'request_id': 'req-55294108-4c46-4925-9430-1fab12b2ed60'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:33.087847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca1c94bee974fb986196c0be4064812', 'request_id': 'req-55294108-4c46-4925-9430-1fab12b2ed60'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:33.099232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] The token cache is being invalidate because project 5ca1c94bee974fb986196c0be4064812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:33.099531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:33.100235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-55294108-4c46-4925-9430-1fab12b2ed60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:33.101829 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1313/2616] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:32 2022] DELETE /identity/v3/projects/5ca1c94bee974fb986196c0be4064812 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:33.107760 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fda11-3d2b-4c3c-aa26-7ae3ad7c286b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.108108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fda11-3d2b-4c3c-aa26-7ae3ad7c286b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.108399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fda11-3d2b-4c3c-aa26-7ae3ad7c286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.128774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-2d0fda11-3d2b-4c3c-aa26-7ae3ad7c286b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:33.129994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-2d0fda11-3d2b-4c3c-aa26-7ae3ad7c286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:33.190179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1304/2617] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:33.198864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c418b99-cb6a-4316-ae2b-267e99c3c424 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.199152 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c418b99-cb6a-4316-ae2b-267e99c3c424 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.199433 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c418b99-cb6a-4316-ae2b-267e99c3c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.218722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-7c418b99-cb6a-4316-ae2b-267e99c3c424 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:33.219938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7c418b99-cb6a-4316-ae2b-267e99c3c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:33.227927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1314/2618] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:33.232075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fda11-3d2b-4c3c-aa26-7ae3ad7c286b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:33.242315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fda11-3d2b-4c3c-aa26-7ae3ad7c286b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:33.246954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d58d2-44bf-4d7b-8818-770e2be466fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:33.247597 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d58d2-44bf-4d7b-8818-770e2be466fd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.247879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d58d2-44bf-4d7b-8818-770e2be466fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.248179 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d58d2-44bf-4d7b-8818-770e2be466fd admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.248921 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d58d2-44bf-4d7b-8818-770e2be466fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:58:33.249238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d58d2-44bf-4d7b-8818-770e2be466fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:33.250875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d58d2-44bf-4d7b-8818-770e2be466fd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:33.262473 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1305/2619] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:58:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:58:33.266546 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c418b99-cb6a-4316-ae2b-267e99c3c424 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:33.276428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c418b99-cb6a-4316-ae2b-267e99c3c424 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:33.281068 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366aa64-8fb1-4136-aff8-a9ae405afb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:33.281697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366aa64-8fb1-4136-aff8-a9ae405afb61 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.281978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366aa64-8fb1-4136-aff8-a9ae405afb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.282252 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366aa64-8fb1-4136-aff8-a9ae405afb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.282986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366aa64-8fb1-4136-aff8-a9ae405afb61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:33.284844 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366aa64-8fb1-4136-aff8-a9ae405afb61 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:33.310567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1315/2620] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:33 2022] POST /identity/v3/projects => generated 404 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:58:33.314692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d58d2-44bf-4d7b-8818-770e2be466fd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:33.324929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d58d2-44bf-4d7b-8818-770e2be466fd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:33.380792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17afe5-4bcd-44c3-82f3-b35af3f654ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:33.381449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17afe5-4bcd-44c3-82f3-b35af3f654ec admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.381733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17afe5-4bcd-44c3-82f3-b35af3f654ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.382009 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17afe5-4bcd-44c3-82f3-b35af3f654ec admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.382712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17afe5-4bcd-44c3-82f3-b35af3f654ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:33.384637 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17afe5-4bcd-44c3-82f3-b35af3f654ec admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:33.405134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1306/2621] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:33 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:58:33.409159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366aa64-8fb1-4136-aff8-a9ae405afb61 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:33.420291 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366aa64-8fb1-4136-aff8-a9ae405afb61 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:33.425028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009fc9e-8133-4e90-87a7-e069c31b1498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:33.425674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fc9e-8133-4e90-87a7-e069c31b1498 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.425963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fc9e-8133-4e90-87a7-e069c31b1498 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.426240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fc9e-8133-4e90-87a7-e069c31b1498 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.427014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009fc9e-8133-4e90-87a7-e069c31b1498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:33.428617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009fc9e-8133-4e90-87a7-e069c31b1498 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:33.438987 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1316/2622] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:33 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:33.442565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17afe5-4bcd-44c3-82f3-b35af3f654ec admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:33.452355 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17afe5-4bcd-44c3-82f3-b35af3f654ec admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:33.457046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c09a9d-2fd5-471c-b219-85fbef270512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:33.457680 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c09a9d-2fd5-471c-b219-85fbef270512 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.457960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c09a9d-2fd5-471c-b219-85fbef270512 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.458232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c09a9d-2fd5-471c-b219-85fbef270512 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.458990 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c09a9d-2fd5-471c-b219-85fbef270512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:33.461184 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c09a9d-2fd5-471c-b219-85fbef270512 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:33.470776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1307/2623] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:33 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:33.474890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009fc9e-8133-4e90-87a7-e069c31b1498 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:33.486207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009fc9e-8133-4e90-87a7-e069c31b1498 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:33.490999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc7805-31f8-4ae6-8f85-65203b13b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:33.491870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc7805-31f8-4ae6-8f85-65203b13b29f admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.492146 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc7805-31f8-4ae6-8f85-65203b13b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.492444 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc7805-31f8-4ae6-8f85-65203b13b29f admin admin] PATH_INFO: `/v3/projects/b6226a83e26b48a898c6374474732118/users/06d9a356ec8642f9bba7088cedbadc6e/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.507461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc7805-31f8-4ae6-8f85-65203b13b29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6226a83e26b48a898c6374474732118, user_id=06d9a356ec8642f9bba7088cedbadc6e, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:33.510066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc7805-31f8-4ae6-8f85-65203b13b29f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:33.523336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1317/2624] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:33 2022] PUT /identity/v3/projects/b6226a83e26b48a898c6374474732118/users/06d9a356ec8642f9bba7088cedbadc6e/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:33.534080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209198-4547-4879-97b2-0af3efb4a060 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.534389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209198-4547-4879-97b2-0af3efb4a060 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.534647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209198-4547-4879-97b2-0af3efb4a060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.692527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-0e209198-4547-4879-97b2-0af3efb4a060 None None] MFA Rules not processed for user `06d9a356ec8642f9bba7088cedbadc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:33.693647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0e209198-4547-4879-97b2-0af3efb4a060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:33.757353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1308/2625] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:33 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:33.761864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc7805-31f8-4ae6-8f85-65203b13b29f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:33.824457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc7805-31f8-4ae6-8f85-65203b13b29f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:33.828936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf70fd5-ff68-429e-b399-8f48ef181ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:33.829601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf70fd5-ff68-429e-b399-8f48ef181ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.829880 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf70fd5-ff68-429e-b399-8f48ef181ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.830179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf70fd5-ff68-429e-b399-8f48ef181ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.830915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf70fd5-ff68-429e-b399-8f48ef181ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:33.832811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf70fd5-ff68-429e-b399-8f48ef181ef4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:33.860831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1318/2626] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:33 2022] POST /identity/v3/projects => generated 404 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:33.864819 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209198-4547-4879-97b2-0af3efb4a060 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:33.875543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209198-4547-4879-97b2-0af3efb4a060 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:33.929784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c191e48-aa39-4dd5-a96f-d52c05bb2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:33.930435 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c191e48-aa39-4dd5-a96f-d52c05bb2f08 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.930715 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c191e48-aa39-4dd5-a96f-d52c05bb2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.931020 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c191e48-aa39-4dd5-a96f-d52c05bb2f08 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.931737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c191e48-aa39-4dd5-a96f-d52c05bb2f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:33.933655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c191e48-aa39-4dd5-a96f-d52c05bb2f08 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:33.953539 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1309/2627] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:33 2022] POST /identity/v3/users => generated 309 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:33.957497 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf70fd5-ff68-429e-b399-8f48ef181ef4 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:33.967462 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf70fd5-ff68-429e-b399-8f48ef181ef4 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:33.971956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af0ac9-28dc-4b71-83c3-e9faf88f9f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:33.972598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af0ac9-28dc-4b71-83c3-e9faf88f9f82 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:33.972878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af0ac9-28dc-4b71-83c3-e9faf88f9f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:33.973150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af0ac9-28dc-4b71-83c3-e9faf88f9f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:33.973879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af0ac9-28dc-4b71-83c3-e9faf88f9f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:33.975528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af0ac9-28dc-4b71-83c3-e9faf88f9f82 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:33.985656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1319/2628] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:33 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:33.989625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c191e48-aa39-4dd5-a96f-d52c05bb2f08 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:33.999853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c191e48-aa39-4dd5-a96f-d52c05bb2f08 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:34.004439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6149b-90dc-4a01-90db-b1a4c04a2fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:34.005302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6149b-90dc-4a01-90db-b1a4c04a2fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:34.005583 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6149b-90dc-4a01-90db-b1a4c04a2fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:34.005859 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6149b-90dc-4a01-90db-b1a4c04a2fc4 admin admin] PATH_INFO: `/v3/projects/8f42a5461b9840a29b2972fa5ce98f87/users/71e1bb990c324743b945f6e4eea52899/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:34.021145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6149b-90dc-4a01-90db-b1a4c04a2fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f42a5461b9840a29b2972fa5ce98f87, user_id=71e1bb990c324743b945f6e4eea52899, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:34.024255 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6149b-90dc-4a01-90db-b1a4c04a2fc4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:34.038420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1310/2629] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:33 2022] PUT /identity/v3/projects/8f42a5461b9840a29b2972fa5ce98f87/users/71e1bb990c324743b945f6e4eea52899/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:34.042323 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af0ac9-28dc-4b71-83c3-e9faf88f9f82 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:34.052401 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af0ac9-28dc-4b71-83c3-e9faf88f9f82 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:34.108499 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac89edf-691c-4eb4-ac15-027f511c5b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:34.109194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac89edf-691c-4eb4-ac15-027f511c5b3c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:34.109476 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac89edf-691c-4eb4-ac15-027f511c5b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:34.109751 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac89edf-691c-4eb4-ac15-027f511c5b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:34.110703 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac89edf-691c-4eb4-ac15-027f511c5b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:34.112073 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac89edf-691c-4eb4-ac15-027f511c5b3c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:34.123098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1320/2630] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:34 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:34.127358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6149b-90dc-4a01-90db-b1a4c04a2fc4 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:34.144148 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6149b-90dc-4a01-90db-b1a4c04a2fc4 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:34.148958 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123d63-af34-483d-9fa8-21aba254e6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:34.149812 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123d63-af34-483d-9fa8-21aba254e6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:34.150120 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123d63-af34-483d-9fa8-21aba254e6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:34.150397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123d63-af34-483d-9fa8-21aba254e6ad admin admin] PATH_INFO: `/v3/projects/8f42a5461b9840a29b2972fa5ce98f87/users/71e1bb990c324743b945f6e4eea52899/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:34.152444 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36123d63-af34-483d-9fa8-21aba254e6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f42a5461b9840a29b2972fa5ce98f87, user_id=71e1bb990c324743b945f6e4eea52899, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:34.155167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36123d63-af34-483d-9fa8-21aba254e6ad admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:34.165751 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1311/2631] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:34 2022] PUT /identity/v3/projects/8f42a5461b9840a29b2972fa5ce98f87/users/71e1bb990c324743b945f6e4eea52899/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:58:34.176094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b49785-dc2c-4547-afcc-b4648cc57334 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:34.176385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b49785-dc2c-4547-afcc-b4648cc57334 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:34.176667 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b49785-dc2c-4547-afcc-b4648cc57334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:34.205253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-e8b49785-dc2c-4547-afcc-b4648cc57334 None None] MFA Rules not processed for user `71e1bb990c324743b945f6e4eea52899`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:34.206460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e8b49785-dc2c-4547-afcc-b4648cc57334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:34.280565 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1321/2632] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:34.290505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123d63-af34-483d-9fa8-21aba254e6ad admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:34.292324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-36123d63-af34-483d-9fa8-21aba254e6ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:34.349201 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123d63-af34-483d-9fa8-21aba254e6ad admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:34.353221 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bf696-d4a9-4c78-925e-20183aacb620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:34.353851 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf696-d4a9-4c78-925e-20183aacb620 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:34.354130 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf696-d4a9-4c78-925e-20183aacb620 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:34.354433 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf696-d4a9-4c78-925e-20183aacb620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:34.363262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bf696-d4a9-4c78-925e-20183aacb620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:34.364721 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bf696-d4a9-4c78-925e-20183aacb620 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:34.374363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1312/2633] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:34 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:34.501255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b49785-dc2c-4547-afcc-b4648cc57334 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:34.562505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b49785-dc2c-4547-afcc-b4648cc57334 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:34.566990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:34.567833 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:34.568110 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:34.568379 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] PATH_INFO: `/v3/users/06d9a356ec8642f9bba7088cedbadc6e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:34.569873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d9a356ec8642f9bba7088cedbadc6e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:34.571833 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:34.615305 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d9a356ec8642f9bba7088cedbadc6e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:34.626373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d9a356ec8642f9bba7088cedbadc6e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:34.627098 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d9a356ec8642f9bba7088cedbadc6e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:34.627690 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d9a356ec8642f9bba7088cedbadc6e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:34.635135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d9a356ec8642f9bba7088cedbadc6e'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:34.648449 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1322/2634] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:34 2022] DELETE /identity/v3/users/06d9a356ec8642f9bba7088cedbadc6e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:34.652977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22d600-d357-498f-a767-d92cc613e66b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:34.653267 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22d600-d357-498f-a767-d92cc613e66b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:34.653543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22d600-d357-498f-a767-d92cc613e66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:34.671579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-bd22d600-d357-498f-a767-d92cc613e66b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:34.672773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-bd22d600-d357-498f-a767-d92cc613e66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:34.729329 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1313/2635] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:34.738966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:34.740315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:34.795291 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcc535-d38b-4f43-bdff-2d59eb6188f8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:34.798855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f13c20-e293-4979-b7ec-249c2aa1bcf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:34.799478 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13c20-e293-4979-b7ec-249c2aa1bcf9 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:34.799755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13c20-e293-4979-b7ec-249c2aa1bcf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:34.800025 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13c20-e293-4979-b7ec-249c2aa1bcf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:34.808929 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f13c20-e293-4979-b7ec-249c2aa1bcf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:34.810321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f13c20-e293-4979-b7ec-249c2aa1bcf9 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:34.819970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1323/2636] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:35.103935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22d600-d357-498f-a767-d92cc613e66b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:35.105365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-bd22d600-d357-498f-a767-d92cc613e66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:35.128378 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22d600-d357-498f-a767-d92cc613e66b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:35.139045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:35.140103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:35.140382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:35.140839 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] PATH_INFO: `/v3/projects/b6226a83e26b48a898c6374474732118` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:35.142072 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6226a83e26b48a898c6374474732118)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:35.144063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:35.196628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6226a83e26b48a898c6374474732118', 'request_id': 'req-f6226114-27a3-419d-b2dd-000b41b1b5a9'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.203979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6226a83e26b48a898c6374474732118', 'request_id': 'req-f6226114-27a3-419d-b2dd-000b41b1b5a9'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.211908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6226a83e26b48a898c6374474732118', 'request_id': 'req-f6226114-27a3-419d-b2dd-000b41b1b5a9'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.223057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] The token cache is being invalidate because project b6226a83e26b48a898c6374474732118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:35.223340 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.223984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.225636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1314/2637] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:35 2022] DELETE /identity/v3/projects/b6226a83e26b48a898c6374474732118 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:35.229628 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f13c20-e293-4979-b7ec-249c2aa1bcf9 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:35.240530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f13c20-e293-4979-b7ec-249c2aa1bcf9 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:35.302115 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9fccd-047d-4a4b-8c57-97d318c8ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:35.303048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9fccd-047d-4a4b-8c57-97d318c8ac62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:35.303873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9fccd-047d-4a4b-8c57-97d318c8ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:35.304150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9fccd-047d-4a4b-8c57-97d318c8ac62 admin admin] PATH_INFO: `/v3/users/71e1bb990c324743b945f6e4eea52899` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:35.305403 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9fccd-047d-4a4b-8c57-97d318c8ac62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e1bb990c324743b945f6e4eea52899)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:35.307353 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9fccd-047d-4a4b-8c57-97d318c8ac62 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:35.365867 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-93a9fccd-047d-4a4b-8c57-97d318c8ac62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e1bb990c324743b945f6e4eea52899'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.377066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-93a9fccd-047d-4a4b-8c57-97d318c8ac62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e1bb990c324743b945f6e4eea52899'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.377731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-93a9fccd-047d-4a4b-8c57-97d318c8ac62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e1bb990c324743b945f6e4eea52899'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.378340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-93a9fccd-047d-4a4b-8c57-97d318c8ac62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e1bb990c324743b945f6e4eea52899'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.385530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-93a9fccd-047d-4a4b-8c57-97d318c8ac62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e1bb990c324743b945f6e4eea52899'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.398051 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1324/2638] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:35 2022] DELETE /identity/v3/users/71e1bb990c324743b945f6e4eea52899 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:35.736168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:35.737607 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:35.751140 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6226114-27a3-419d-b2dd-000b41b1b5a9 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:35.816392 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:35.817272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:35.817598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:35.817831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] PATH_INFO: `/v3/projects/8f42a5461b9840a29b2972fa5ce98f87` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:35.819087 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f42a5461b9840a29b2972fa5ce98f87)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:35.821050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:35.866671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f42a5461b9840a29b2972fa5ce98f87', 'request_id': 'req-badf2bd5-49fc-42ac-b53e-32b641e1de31'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.873528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f42a5461b9840a29b2972fa5ce98f87', 'request_id': 'req-badf2bd5-49fc-42ac-b53e-32b641e1de31'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.879650 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f42a5461b9840a29b2972fa5ce98f87', 'request_id': 'req-badf2bd5-49fc-42ac-b53e-32b641e1de31'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.889776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] The token cache is being invalidate because project 8f42a5461b9840a29b2972fa5ce98f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:35.890065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.890703 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-badf2bd5-49fc-42ac-b53e-32b641e1de31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:35.892304 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1315/2639] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:35 2022] DELETE /identity/v3/projects/8f42a5461b9840a29b2972fa5ce98f87 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:35.898453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026dd73-6a02-4423-9c8c-28491548c0da None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:35.898740 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026dd73-6a02-4423-9c8c-28491548c0da None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:35.899112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026dd73-6a02-4423-9c8c-28491548c0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:35.917123 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-4026dd73-6a02-4423-9c8c-28491548c0da None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:35.918346 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4026dd73-6a02-4423-9c8c-28491548c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:36.111439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1325/2640] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:36.120286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9744986-7e2b-4a96-b3af-9d155adc0bb4 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.120572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9744986-7e2b-4a96-b3af-9d155adc0bb4 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.120850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9744986-7e2b-4a96-b3af-9d155adc0bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.139162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-b9744986-7e2b-4a96-b3af-9d155adc0bb4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:36.140351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b9744986-7e2b-4a96-b3af-9d155adc0bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:36.148118 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1316/2641] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:58:36.152395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026dd73-6a02-4423-9c8c-28491548c0da None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.162370 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026dd73-6a02-4423-9c8c-28491548c0da None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.167481 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09353ad-5bd2-4c3c-89c6-4a41e8daae24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.168137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09353ad-5bd2-4c3c-89c6-4a41e8daae24 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.168420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09353ad-5bd2-4c3c-89c6-4a41e8daae24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.168691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09353ad-5bd2-4c3c-89c6-4a41e8daae24 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.169422 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09353ad-5bd2-4c3c-89c6-4a41e8daae24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:58:36.169977 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09353ad-5bd2-4c3c-89c6-4a41e8daae24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.171634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09353ad-5bd2-4c3c-89c6-4a41e8daae24 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.183899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1326/2642] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:58:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:58:36.188105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9744986-7e2b-4a96-b3af-9d155adc0bb4 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.197752 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9744986-7e2b-4a96-b3af-9d155adc0bb4 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.202345 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487016-364e-4a97-87ec-28d6159a4939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.203017 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487016-364e-4a97-87ec-28d6159a4939 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.203306 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487016-364e-4a97-87ec-28d6159a4939 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.203580 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487016-364e-4a97-87ec-28d6159a4939 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.204273 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487016-364e-4a97-87ec-28d6159a4939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.206154 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487016-364e-4a97-87ec-28d6159a4939 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.230150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1317/2643] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:36 2022] POST /identity/v3/projects => generated 380 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:36.234156 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09353ad-5bd2-4c3c-89c6-4a41e8daae24 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.244388 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09353ad-5bd2-4c3c-89c6-4a41e8daae24 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.299603 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d521c5-1218-4c08-9745-56ef88415822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.300292 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d521c5-1218-4c08-9745-56ef88415822 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.300573 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d521c5-1218-4c08-9745-56ef88415822 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.300848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d521c5-1218-4c08-9745-56ef88415822 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.301551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d521c5-1218-4c08-9745-56ef88415822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.304196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d521c5-1218-4c08-9745-56ef88415822 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.324945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1327/2644] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:36 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:58:36.329183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487016-364e-4a97-87ec-28d6159a4939 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.339178 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487016-364e-4a97-87ec-28d6159a4939 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.343959 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168e2ce-a673-4bb1-a947-90122eecb293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.344609 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168e2ce-a673-4bb1-a947-90122eecb293 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.344891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168e2ce-a673-4bb1-a947-90122eecb293 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.345167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168e2ce-a673-4bb1-a947-90122eecb293 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.345906 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168e2ce-a673-4bb1-a947-90122eecb293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.347658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168e2ce-a673-4bb1-a947-90122eecb293 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.359111 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1318/2645] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:36.363221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d521c5-1218-4c08-9745-56ef88415822 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.373629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d521c5-1218-4c08-9745-56ef88415822 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.378318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1f60b-2ce1-4a72-90af-5c7378adb60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.378992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1f60b-2ce1-4a72-90af-5c7378adb60c admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.379277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1f60b-2ce1-4a72-90af-5c7378adb60c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.379551 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1f60b-2ce1-4a72-90af-5c7378adb60c admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.380290 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1f60b-2ce1-4a72-90af-5c7378adb60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.382613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1f60b-2ce1-4a72-90af-5c7378adb60c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.392917 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1328/2646] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:36.396879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168e2ce-a673-4bb1-a947-90122eecb293 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.407276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168e2ce-a673-4bb1-a947-90122eecb293 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.412728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0682fbb-4219-4edc-87c8-74b4870d85c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.413704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0682fbb-4219-4edc-87c8-74b4870d85c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.413988 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0682fbb-4219-4edc-87c8-74b4870d85c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.414263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0682fbb-4219-4edc-87c8-74b4870d85c7 admin admin] PATH_INFO: `/v3/projects/d41f7b7415574b47a78dd64795b9f961/users/7a52ea59779e41c5a57e210fb26af5e7/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.429102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0682fbb-4219-4edc-87c8-74b4870d85c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41f7b7415574b47a78dd64795b9f961, user_id=7a52ea59779e41c5a57e210fb26af5e7, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.431758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0682fbb-4219-4edc-87c8-74b4870d85c7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.446082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1319/2647] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:36 2022] PUT /identity/v3/projects/d41f7b7415574b47a78dd64795b9f961/users/7a52ea59779e41c5a57e210fb26af5e7/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:36.458242 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b765ff-6887-4e8a-912c-713e03b62919 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.458458 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b765ff-6887-4e8a-912c-713e03b62919 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.458735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b765ff-6887-4e8a-912c-713e03b62919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.487312 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-e8b765ff-6887-4e8a-912c-713e03b62919 None None] MFA Rules not processed for user `7a52ea59779e41c5a57e210fb26af5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:36.488878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e8b765ff-6887-4e8a-912c-713e03b62919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:36.554389 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1329/2648] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:36.558840 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0682fbb-4219-4edc-87c8-74b4870d85c7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.617522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0682fbb-4219-4edc-87c8-74b4870d85c7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.622068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e92b1a-0b9f-4a35-a462-2deb97bf9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.622711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e92b1a-0b9f-4a35-a462-2deb97bf9217 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.623028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e92b1a-0b9f-4a35-a462-2deb97bf9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.623309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e92b1a-0b9f-4a35-a462-2deb97bf9217 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.624014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e92b1a-0b9f-4a35-a462-2deb97bf9217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.625884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e92b1a-0b9f-4a35-a462-2deb97bf9217 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.649788 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1320/2649] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:36 2022] POST /identity/v3/projects => generated 380 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:58:36.653814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b765ff-6887-4e8a-912c-713e03b62919 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.664795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b765ff-6887-4e8a-912c-713e03b62919 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.717483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1c87c-92be-4c55-8c20-cabfe8ff9427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.718128 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1c87c-92be-4c55-8c20-cabfe8ff9427 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.718407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1c87c-92be-4c55-8c20-cabfe8ff9427 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.718684 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1c87c-92be-4c55-8c20-cabfe8ff9427 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.719405 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1c87c-92be-4c55-8c20-cabfe8ff9427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.721268 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1c87c-92be-4c55-8c20-cabfe8ff9427 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.742058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1330/2650] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:36 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:36.745994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e92b1a-0b9f-4a35-a462-2deb97bf9217 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.755723 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e92b1a-0b9f-4a35-a462-2deb97bf9217 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.760791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f43a0-048b-4725-8bfc-1dcdc322bccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.761426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f43a0-048b-4725-8bfc-1dcdc322bccf admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.761704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f43a0-048b-4725-8bfc-1dcdc322bccf admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.761972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f43a0-048b-4725-8bfc-1dcdc322bccf admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.762699 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f43a0-048b-4725-8bfc-1dcdc322bccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.764356 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f43a0-048b-4725-8bfc-1dcdc322bccf admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.774947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1321/2651] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:36.779094 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1c87c-92be-4c55-8c20-cabfe8ff9427 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.789392 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1c87c-92be-4c55-8c20-cabfe8ff9427 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.793945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88ff02-1505-4817-9158-dcc27c9ee04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.795566 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88ff02-1505-4817-9158-dcc27c9ee04f admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.795566 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88ff02-1505-4817-9158-dcc27c9ee04f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.795755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88ff02-1505-4817-9158-dcc27c9ee04f admin admin] PATH_INFO: `/v3/projects/6e3b023817c64410bd830471d9b73d77/users/be22af7f62f146baa02877ad51eb10f5/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.811247 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88ff02-1505-4817-9158-dcc27c9ee04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3b023817c64410bd830471d9b73d77, user_id=be22af7f62f146baa02877ad51eb10f5, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.813865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88ff02-1505-4817-9158-dcc27c9ee04f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.827606 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1331/2652] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:36 2022] PUT /identity/v3/projects/6e3b023817c64410bd830471d9b73d77/users/be22af7f62f146baa02877ad51eb10f5/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:36.831541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f43a0-048b-4725-8bfc-1dcdc322bccf admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.842144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f43a0-048b-4725-8bfc-1dcdc322bccf admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.897430 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bc523-1b70-4392-8402-25bee6fc589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.898100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bc523-1b70-4392-8402-25bee6fc589a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.898383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bc523-1b70-4392-8402-25bee6fc589a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.898657 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bc523-1b70-4392-8402-25bee6fc589a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.899438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bc523-1b70-4392-8402-25bee6fc589a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.901015 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bc523-1b70-4392-8402-25bee6fc589a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.910791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1322/2653] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:36.915559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88ff02-1505-4817-9158-dcc27c9ee04f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:36.925635 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88ff02-1505-4817-9158-dcc27c9ee04f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:36.930682 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50970563-b860-443e-ba02-6fa250e568d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:36.931580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970563-b860-443e-ba02-6fa250e568d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.931860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970563-b860-443e-ba02-6fa250e568d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.932139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970563-b860-443e-ba02-6fa250e568d6 admin admin] PATH_INFO: `/v3/projects/6e3b023817c64410bd830471d9b73d77/users/be22af7f62f146baa02877ad51eb10f5/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.934344 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50970563-b860-443e-ba02-6fa250e568d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3b023817c64410bd830471d9b73d77, user_id=be22af7f62f146baa02877ad51eb10f5, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:36.936973 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50970563-b860-443e-ba02-6fa250e568d6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:36.947788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1332/2654] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:36 2022] PUT /identity/v3/projects/6e3b023817c64410bd830471d9b73d77/users/be22af7f62f146baa02877ad51eb10f5/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:36.958272 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912773d6-cd13-47b8-822f-4aeb1b8df3b3 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:36.958598 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912773d6-cd13-47b8-822f-4aeb1b8df3b3 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:36.958914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912773d6-cd13-47b8-822f-4aeb1b8df3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:36.986266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-912773d6-cd13-47b8-822f-4aeb1b8df3b3 None None] MFA Rules not processed for user `be22af7f62f146baa02877ad51eb10f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:36.987496 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-912773d6-cd13-47b8-822f-4aeb1b8df3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:37.052885 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1323/2655] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:37.062995 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50970563-b860-443e-ba02-6fa250e568d6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:37.064675 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-50970563-b860-443e-ba02-6fa250e568d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:37.119439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50970563-b860-443e-ba02-6fa250e568d6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:37.123119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366647c8-da03-4d65-8966-2d7dfd4fff0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:37.123738 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366647c8-da03-4d65-8966-2d7dfd4fff0f service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:37.124055 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366647c8-da03-4d65-8966-2d7dfd4fff0f service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:37.124325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366647c8-da03-4d65-8966-2d7dfd4fff0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:37.133252 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366647c8-da03-4d65-8966-2d7dfd4fff0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:37.134700 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366647c8-da03-4d65-8966-2d7dfd4fff0f service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:37.144159 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1333/2656] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:37.214613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912773d6-cd13-47b8-822f-4aeb1b8df3b3 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:37.224106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912773d6-cd13-47b8-822f-4aeb1b8df3b3 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:37.228682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797725b-eca6-4bad-9007-cba48e19bbc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:37.229302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797725b-eca6-4bad-9007-cba48e19bbc9 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:37.229581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797725b-eca6-4bad-9007-cba48e19bbc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:37.229853 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797725b-eca6-4bad-9007-cba48e19bbc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:37.286031 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797725b-eca6-4bad-9007-cba48e19bbc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:37.287824 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797725b-eca6-4bad-9007-cba48e19bbc9 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:37.297209 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1324/2657] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:47.330407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366647c8-da03-4d65-8966-2d7dfd4fff0f service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:47.332639 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-366647c8-da03-4d65-8966-2d7dfd4fff0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:47.420225 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366647c8-da03-4d65-8966-2d7dfd4fff0f service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:47.425850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9704-2b7b-4910-9b41-105aff3c0570 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15975bd016ed48f9bf5c88845180ebf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:47.426571 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9704-2b7b-4910-9b41-105aff3c0570 service placement] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:47.426954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9704-2b7b-4910-9b41-105aff3c0570 service placement] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:47.427272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9704-2b7b-4910-9b41-105aff3c0570 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:47.429818 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-292e9704-2b7b-4910-9b41-105aff3c0570 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:47.442076 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e9704-2b7b-4910-9b41-105aff3c0570 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:47.443756 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e9704-2b7b-4910-9b41-105aff3c0570 service placement] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:47.454008 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1334/2658] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:58:49.006950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cf836-917c-4562-a16c-d1280d92416d None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:49.007822 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cf836-917c-4562-a16c-d1280d92416d None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:49.008198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cf836-917c-4562-a16c-d1280d92416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:49.027343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-776cf836-917c-4562-a16c-d1280d92416d None None] MFA Rules not processed for user `40a416737b484014bb7cf011bab63b63`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:49.028747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-776cf836-917c-4562-a16c-d1280d92416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:49.087320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1325/2659] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:50.215568 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9704-2b7b-4910-9b41-105aff3c0570 service placement] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:50.289707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9704-2b7b-4910-9b41-105aff3c0570 service placement] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:50.294647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:50.295635 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:50.295916 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:50.296194 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] PATH_INFO: `/v3/users/7a52ea59779e41c5a57e210fb26af5e7` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:50.297426 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a52ea59779e41c5a57e210fb26af5e7)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:50.299353 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:50.354113 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a52ea59779e41c5a57e210fb26af5e7'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:50.366908 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a52ea59779e41c5a57e210fb26af5e7'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:50.367669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a52ea59779e41c5a57e210fb26af5e7'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:50.368320 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a52ea59779e41c5a57e210fb26af5e7'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:50.377512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a52ea59779e41c5a57e210fb26af5e7'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:50.395289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1335/2660] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:50 2022] DELETE /identity/v3/users/7a52ea59779e41c5a57e210fb26af5e7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:50.401249 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a769aa-ae6b-4f9d-8b00-d6c8b7b68ece None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:50.401891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a769aa-ae6b-4f9d-8b00-d6c8b7b68ece None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:50.401891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a769aa-ae6b-4f9d-8b00-d6c8b7b68ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:50.421109 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-27a769aa-ae6b-4f9d-8b00-d6c8b7b68ece None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:50.422339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-27a769aa-ae6b-4f9d-8b00-d6c8b7b68ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:50.482413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1326/2661] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:58:50.493285 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:50.494686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:50.564214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e2380-3ab1-47c1-bd10-8f479c6346de admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:50.566556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6da0-6507-4107-adb7-56f59155a524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:50.567208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6da0-6507-4107-adb7-56f59155a524 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:50.567485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6da0-6507-4107-adb7-56f59155a524 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:50.568299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6da0-6507-4107-adb7-56f59155a524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:50.578103 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa6da0-6507-4107-adb7-56f59155a524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:50.579538 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa6da0-6507-4107-adb7-56f59155a524 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:50.590717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1336/2662] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:50.957768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a769aa-ae6b-4f9d-8b00-d6c8b7b68ece None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:50.959902 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-27a769aa-ae6b-4f9d-8b00-d6c8b7b68ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:50.977675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a769aa-ae6b-4f9d-8b00-d6c8b7b68ece None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:50.982896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:50.984248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:50.984705 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:50.985158 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] PATH_INFO: `/v3/projects/d41f7b7415574b47a78dd64795b9f961` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:50.986805 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41f7b7415574b47a78dd64795b9f961)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:50.988872 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:51.050825 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41f7b7415574b47a78dd64795b9f961', 'request_id': 'req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.058774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41f7b7415574b47a78dd64795b9f961', 'request_id': 'req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.065912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41f7b7415574b47a78dd64795b9f961', 'request_id': 'req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.077594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] The token cache is being invalidate because project d41f7b7415574b47a78dd64795b9f961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:51.077881 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.078596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.080411 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1327/2663] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:50 2022] DELETE /identity/v3/projects/d41f7b7415574b47a78dd64795b9f961 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:51.084870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6da0-6507-4107-adb7-56f59155a524 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:51.094957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6da0-6507-4107-adb7-56f59155a524 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:51.159801 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7be547-7ca9-418c-92f5-900fdbab4fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:51.160620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7be547-7ca9-418c-92f5-900fdbab4fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:51.160899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7be547-7ca9-418c-92f5-900fdbab4fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:51.161172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7be547-7ca9-418c-92f5-900fdbab4fc3 admin admin] PATH_INFO: `/v3/users/be22af7f62f146baa02877ad51eb10f5` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:51.163369 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7be547-7ca9-418c-92f5-900fdbab4fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be22af7f62f146baa02877ad51eb10f5)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:51.165336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7be547-7ca9-418c-92f5-900fdbab4fc3 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:51.224032 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-af7be547-7ca9-418c-92f5-900fdbab4fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be22af7f62f146baa02877ad51eb10f5'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.236535 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-af7be547-7ca9-418c-92f5-900fdbab4fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be22af7f62f146baa02877ad51eb10f5'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.237265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-af7be547-7ca9-418c-92f5-900fdbab4fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be22af7f62f146baa02877ad51eb10f5'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.237923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-af7be547-7ca9-418c-92f5-900fdbab4fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be22af7f62f146baa02877ad51eb10f5'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.246956 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-af7be547-7ca9-418c-92f5-900fdbab4fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be22af7f62f146baa02877ad51eb10f5'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.265925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1337/2664] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:51 2022] DELETE /identity/v3/users/be22af7f62f146baa02877ad51eb10f5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:51.556976 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:51.559216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:51.580949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7ddc1-f0d8-4110-a5c3-6acede79a997 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:51.639965 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:51.640916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:51.641568 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:51.641945 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] PATH_INFO: `/v3/projects/6e3b023817c64410bd830471d9b73d77` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:51.643263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3b023817c64410bd830471d9b73d77)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:51.645237 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:51.696615 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3b023817c64410bd830471d9b73d77', 'request_id': 'req-c085d529-036d-46c8-a7b5-ce234fe2b94c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.706084 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3b023817c64410bd830471d9b73d77', 'request_id': 'req-c085d529-036d-46c8-a7b5-ce234fe2b94c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.713554 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3b023817c64410bd830471d9b73d77', 'request_id': 'req-c085d529-036d-46c8-a7b5-ce234fe2b94c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.725159 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] The token cache is being invalidate because project 6e3b023817c64410bd830471d9b73d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:51.725446 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.726198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-c085d529-036d-46c8-a7b5-ce234fe2b94c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:51.727967 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1328/2665] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:51 2022] DELETE /identity/v3/projects/6e3b023817c64410bd830471d9b73d77 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:51.735936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fdc17-044e-4721-9a6d-acfc1fb5dbec None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:51.736355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fdc17-044e-4721-9a6d-acfc1fb5dbec None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:51.736705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fdc17-044e-4721-9a6d-acfc1fb5dbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:51.759737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ee2fdc17-044e-4721-9a6d-acfc1fb5dbec None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:51.760961 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ee2fdc17-044e-4721-9a6d-acfc1fb5dbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:51.843151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1338/2666] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:51.850649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42d414-4347-4aa9-a2d9-0bdaa001e807 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:51.851340 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42d414-4347-4aa9-a2d9-0bdaa001e807 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:51.852648 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42d414-4347-4aa9-a2d9-0bdaa001e807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:51.883596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-0d42d414-4347-4aa9-a2d9-0bdaa001e807 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:51.885899 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0d42d414-4347-4aa9-a2d9-0bdaa001e807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:51.898838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1329/2667] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:51.903216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fdc17-044e-4721-9a6d-acfc1fb5dbec None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:51.915391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fdc17-044e-4721-9a6d-acfc1fb5dbec None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:51.924489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf798a-3f80-4c7e-ac83-2c794397eede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:51.925492 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf798a-3f80-4c7e-ac83-2c794397eede admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:51.925849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf798a-3f80-4c7e-ac83-2c794397eede admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:51.926271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf798a-3f80-4c7e-ac83-2c794397eede admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:51.927169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf798a-3f80-4c7e-ac83-2c794397eede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:58:51.927585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf798a-3f80-4c7e-ac83-2c794397eede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:51.929374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf798a-3f80-4c7e-ac83-2c794397eede admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:51.948753 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42d414-4347-4aa9-a2d9-0bdaa001e807 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:51.960886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42d414-4347-4aa9-a2d9-0bdaa001e807 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:51.961938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1339/2668] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:58:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:58:51.966248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ed59d-a071-47e4-b8c7-d6c247abb827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:51.966950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed59d-a071-47e4-b8c7-d6c247abb827 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:51.967235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed59d-a071-47e4-b8c7-d6c247abb827 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:51.967513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed59d-a071-47e4-b8c7-d6c247abb827 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:51.968386 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ed59d-a071-47e4-b8c7-d6c247abb827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:51.970884 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ed59d-a071-47e4-b8c7-d6c247abb827 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:52.010841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf798a-3f80-4c7e-ac83-2c794397eede admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:52.017762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1330/2669] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:51 2022] POST /identity/v3/projects => generated 380 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:52.025955 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf798a-3f80-4c7e-ac83-2c794397eede admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:52.112567 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219efe4c-f22a-44b1-854e-b27a9b7a1f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:52.113527 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219efe4c-f22a-44b1-854e-b27a9b7a1f35 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.115410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219efe4c-f22a-44b1-854e-b27a9b7a1f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.116057 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219efe4c-f22a-44b1-854e-b27a9b7a1f35 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.118060 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219efe4c-f22a-44b1-854e-b27a9b7a1f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:52.120857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219efe4c-f22a-44b1-854e-b27a9b7a1f35 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:52.158270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1340/2670] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:52 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:52.162614 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ed59d-a071-47e4-b8c7-d6c247abb827 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:52.175104 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ed59d-a071-47e4-b8c7-d6c247abb827 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:52.180912 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130d497-6806-4e28-9430-9aaa60cb0cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:52.181643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130d497-6806-4e28-9430-9aaa60cb0cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.181923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130d497-6806-4e28-9430-9aaa60cb0cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.182191 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130d497-6806-4e28-9430-9aaa60cb0cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.183133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130d497-6806-4e28-9430-9aaa60cb0cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:52.184750 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130d497-6806-4e28-9430-9aaa60cb0cc3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:52.196579 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1331/2671] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:52 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:52.200808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219efe4c-f22a-44b1-854e-b27a9b7a1f35 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:52.213456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219efe4c-f22a-44b1-854e-b27a9b7a1f35 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:52.229659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c08ac8-28a0-4abe-86a6-40317e4231ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:52.231292 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c08ac8-28a0-4abe-86a6-40317e4231ae admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.231292 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c08ac8-28a0-4abe-86a6-40317e4231ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.231292 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c08ac8-28a0-4abe-86a6-40317e4231ae admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.232002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c08ac8-28a0-4abe-86a6-40317e4231ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:52.233673 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c08ac8-28a0-4abe-86a6-40317e4231ae admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:52.243891 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1341/2672] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:52 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:52.248321 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130d497-6806-4e28-9430-9aaa60cb0cc3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:52.259414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130d497-6806-4e28-9430-9aaa60cb0cc3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:52.264622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e1c85-85c2-4a92-9203-78465fe6195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:52.265479 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e1c85-85c2-4a92-9203-78465fe6195e admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.265758 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e1c85-85c2-4a92-9203-78465fe6195e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.266026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e1c85-85c2-4a92-9203-78465fe6195e admin admin] PATH_INFO: `/v3/projects/5eb62ee7e4524ec2b67cfdb88d59cdee/users/a37c697826064c738150ed7e2fc5aee3/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.281265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e1c85-85c2-4a92-9203-78465fe6195e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb62ee7e4524ec2b67cfdb88d59cdee, user_id=a37c697826064c738150ed7e2fc5aee3, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:52.283916 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e1c85-85c2-4a92-9203-78465fe6195e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:52.296984 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1332/2673] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:52 2022] PUT /identity/v3/projects/5eb62ee7e4524ec2b67cfdb88d59cdee/users/a37c697826064c738150ed7e2fc5aee3/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:58:52.307556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533de6f6-d9e6-41c2-9cf1-50699351ae35 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.307946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533de6f6-d9e6-41c2-9cf1-50699351ae35 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.308312 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533de6f6-d9e6-41c2-9cf1-50699351ae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.335509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-533de6f6-d9e6-41c2-9cf1-50699351ae35 None None] MFA Rules not processed for user `a37c697826064c738150ed7e2fc5aee3`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:52.336766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-533de6f6-d9e6-41c2-9cf1-50699351ae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:52.406053 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1342/2674] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:52.410562 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e1c85-85c2-4a92-9203-78465fe6195e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:52.485800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e1c85-85c2-4a92-9203-78465fe6195e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:52.492854 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50677813-cacb-4678-b315-f584bf6a6f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:52.493523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50677813-cacb-4678-b315-f584bf6a6f2c admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.493800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50677813-cacb-4678-b315-f584bf6a6f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.494075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50677813-cacb-4678-b315-f584bf6a6f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.494817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50677813-cacb-4678-b315-f584bf6a6f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:52.496879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50677813-cacb-4678-b315-f584bf6a6f2c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:52.530957 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1333/2675] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:52 2022] POST /identity/v3/projects => generated 382 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:52.532483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533de6f6-d9e6-41c2-9cf1-50699351ae35 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:52.544685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533de6f6-d9e6-41c2-9cf1-50699351ae35 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:52.609241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d60ba-4607-4fb7-b415-61ad7f0f0227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:52.610067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d60ba-4607-4fb7-b415-61ad7f0f0227 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.610457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d60ba-4607-4fb7-b415-61ad7f0f0227 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.610874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d60ba-4607-4fb7-b415-61ad7f0f0227 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.611679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d60ba-4607-4fb7-b415-61ad7f0f0227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:52.613847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d60ba-4607-4fb7-b415-61ad7f0f0227 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:52.642221 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1343/2676] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:52 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:58:52.646733 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50677813-cacb-4678-b315-f584bf6a6f2c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:52.658298 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50677813-cacb-4678-b315-f584bf6a6f2c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:52.678835 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13d2f4-6eea-4561-8cf4-0f7fd3a76a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:52.679725 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13d2f4-6eea-4561-8cf4-0f7fd3a76a9a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.680169 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13d2f4-6eea-4561-8cf4-0f7fd3a76a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.680605 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13d2f4-6eea-4561-8cf4-0f7fd3a76a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.683218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13d2f4-6eea-4561-8cf4-0f7fd3a76a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:52.685879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13d2f4-6eea-4561-8cf4-0f7fd3a76a9a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:52.701555 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1334/2677] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:52 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:58:52.705794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d60ba-4607-4fb7-b415-61ad7f0f0227 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:52.716791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d60ba-4607-4fb7-b415-61ad7f0f0227 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:52.722048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b86202-a703-417c-9d42-4bdc3d5b009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:52.722970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b86202-a703-417c-9d42-4bdc3d5b009f admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.723256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b86202-a703-417c-9d42-4bdc3d5b009f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.723536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b86202-a703-417c-9d42-4bdc3d5b009f admin admin] PATH_INFO: `/v3/projects/ad773d955b574fbca23a5a0a438b1a03/users/9c6b30f42a6e4578a15e5e59abe99568/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.743192 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b86202-a703-417c-9d42-4bdc3d5b009f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad773d955b574fbca23a5a0a438b1a03, user_id=9c6b30f42a6e4578a15e5e59abe99568, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:52.745992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b86202-a703-417c-9d42-4bdc3d5b009f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:52.769089 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1344/2678] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:52 2022] PUT /identity/v3/projects/ad773d955b574fbca23a5a0a438b1a03/users/9c6b30f42a6e4578a15e5e59abe99568/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:52.773096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13d2f4-6eea-4561-8cf4-0f7fd3a76a9a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:52.784775 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13d2f4-6eea-4561-8cf4-0f7fd3a76a9a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:52.846573 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8ce1b-0eff-4718-856b-0b66b7b9a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:52.847318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ce1b-0eff-4718-856b-0b66b7b9a047 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.847600 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ce1b-0eff-4718-856b-0b66b7b9a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.847879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ce1b-0eff-4718-856b-0b66b7b9a047 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.848671 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8ce1b-0eff-4718-856b-0b66b7b9a047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:52.850320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8ce1b-0eff-4718-856b-0b66b7b9a047 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:52.860930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1335/2679] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:52 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:52.865637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b86202-a703-417c-9d42-4bdc3d5b009f admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:52.876169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b86202-a703-417c-9d42-4bdc3d5b009f admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:52.881731 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584a84f-96e8-4818-ba63-ac7f1553d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:52.882841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584a84f-96e8-4818-ba63-ac7f1553d18e admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.883127 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584a84f-96e8-4818-ba63-ac7f1553d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.883402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584a84f-96e8-4818-ba63-ac7f1553d18e admin admin] PATH_INFO: `/v3/projects/ad773d955b574fbca23a5a0a438b1a03/users/9c6b30f42a6e4578a15e5e59abe99568/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.885388 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584a84f-96e8-4818-ba63-ac7f1553d18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad773d955b574fbca23a5a0a438b1a03, user_id=9c6b30f42a6e4578a15e5e59abe99568, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:52.888153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584a84f-96e8-4818-ba63-ac7f1553d18e admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:52.902043 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1345/2680] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:52 2022] PUT /identity/v3/projects/ad773d955b574fbca23a5a0a438b1a03/users/9c6b30f42a6e4578a15e5e59abe99568/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:52.912219 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1b32e-9388-4b5a-9a40-b271c21d704e None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:52.912506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1b32e-9388-4b5a-9a40-b271c21d704e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:52.912780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1b32e-9388-4b5a-9a40-b271c21d704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:52.938549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-46c1b32e-9388-4b5a-9a40-b271c21d704e None None] MFA Rules not processed for user `9c6b30f42a6e4578a15e5e59abe99568`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:52.939776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-46c1b32e-9388-4b5a-9a40-b271c21d704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:53.005064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1336/2681] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:53.016176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584a84f-96e8-4818-ba63-ac7f1553d18e admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:53.017906 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b584a84f-96e8-4818-ba63-ac7f1553d18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:53.073526 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584a84f-96e8-4818-ba63-ac7f1553d18e admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:53.077102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1f41a-0ab5-4ef3-b07b-cb3c61603231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:53.077724 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f41a-0ab5-4ef3-b07b-cb3c61603231 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:53.078003 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f41a-0ab5-4ef3-b07b-cb3c61603231 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:53.078272 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f41a-0ab5-4ef3-b07b-cb3c61603231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:53.087057 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1f41a-0ab5-4ef3-b07b-cb3c61603231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:53.088483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1f41a-0ab5-4ef3-b07b-cb3c61603231 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:53.097399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1346/2682] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:53.399266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1b32e-9388-4b5a-9a40-b271c21d704e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:53.408361 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1b32e-9388-4b5a-9a40-b271c21d704e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:53.413073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a538658-a61d-48ed-87e8-479cecfa60f3 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6b30f42a6e4578a15e5e59abe99568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad773d955b574fbca23a5a0a438b1a03', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:53.413719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538658-a61d-48ed-87e8-479cecfa60f3 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:53.414008 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538658-a61d-48ed-87e8-479cecfa60f3 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:53.414290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538658-a61d-48ed-87e8-479cecfa60f3 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:53.415062 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a538658-a61d-48ed-87e8-479cecfa60f3 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:58:53.415373 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a538658-a61d-48ed-87e8-479cecfa60f3 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:53.417073 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a538658-a61d-48ed-87e8-479cecfa60f3 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:53.429040 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1337/2683] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:58:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:58:53.432937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1f41a-0ab5-4ef3-b07b-cb3c61603231 service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:53.441837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1f41a-0ab5-4ef3-b07b-cb3c61603231 service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:53.447022 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89843885-4dcc-4d8a-bf38-99d39228a249 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6b30f42a6e4578a15e5e59abe99568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad773d955b574fbca23a5a0a438b1a03', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:53.447652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89843885-4dcc-4d8a-bf38-99d39228a249 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:53.447953 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89843885-4dcc-4d8a-bf38-99d39228a249 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:53.448229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89843885-4dcc-4d8a-bf38-99d39228a249 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:53.448926 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89843885-4dcc-4d8a-bf38-99d39228a249 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:53.450789 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89843885-4dcc-4d8a-bf38-99d39228a249 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:53.476894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1347/2684] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:53 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:53.481538 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a538658-a61d-48ed-87e8-479cecfa60f3 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:53.492394 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a538658-a61d-48ed-87e8-479cecfa60f3 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:53.548085 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088f7d-60c8-4741-8bda-8f13128a8dad tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6b30f42a6e4578a15e5e59abe99568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad773d955b574fbca23a5a0a438b1a03', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:53.548748 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088f7d-60c8-4741-8bda-8f13128a8dad tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:53.549034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088f7d-60c8-4741-8bda-8f13128a8dad tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:53.549312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088f7d-60c8-4741-8bda-8f13128a8dad tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:53.550103 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088f7d-60c8-4741-8bda-8f13128a8dad tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:58:53.550410 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088f7d-60c8-4741-8bda-8f13128a8dad tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:53.553079 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088f7d-60c8-4741-8bda-8f13128a8dad tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:53.566096 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1338/2685] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:58:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:58:53.604049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89843885-4dcc-4d8a-bf38-99d39228a249 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:53.614113 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89843885-4dcc-4d8a-bf38-99d39228a249 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:53.619783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6b30f42a6e4578a15e5e59abe99568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad773d955b574fbca23a5a0a438b1a03', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:53.620674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:53.620954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:53.621234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] PATH_INFO: `/v3/projects/dee6667c18f444e68459ed31588e5d3c` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:53.622412 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dee6667c18f444e68459ed31588e5d3c)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:53.624301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:53.671913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee6667c18f444e68459ed31588e5d3c', 'request_id': 'req-bdddfb54-336e-4ef8-b867-c38dc44ed452'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:53.677596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee6667c18f444e68459ed31588e5d3c', 'request_id': 'req-bdddfb54-336e-4ef8-b867-c38dc44ed452'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:53.684636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee6667c18f444e68459ed31588e5d3c', 'request_id': 'req-bdddfb54-336e-4ef8-b867-c38dc44ed452'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:53.696590 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] The token cache is being invalidate because project dee6667c18f444e68459ed31588e5d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:53.696877 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:53.697659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bdddfb54-336e-4ef8-b867-c38dc44ed452 tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:53.699288 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1348/2686] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:53 2022] DELETE /identity/v3/projects/dee6667c18f444e68459ed31588e5d3c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:53.882693 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088f7d-60c8-4741-8bda-8f13128a8dad tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:53.884878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1b088f7d-60c8-4741-8bda-8f13128a8dad tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:53.948755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088f7d-60c8-4741-8bda-8f13128a8dad tempest-VolumeQuotaClassesTest-1969644129 tempest-VolumeQuotaClassesTest-1969644129-project-admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:54.003232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:54.004112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:54.004400 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:54.004675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] PATH_INFO: `/v3/users/a37c697826064c738150ed7e2fc5aee3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:54.005927 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37c697826064c738150ed7e2fc5aee3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:54.007902 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:54.054305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37c697826064c738150ed7e2fc5aee3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.061091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37c697826064c738150ed7e2fc5aee3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.067909 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37c697826064c738150ed7e2fc5aee3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.078967 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37c697826064c738150ed7e2fc5aee3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.079609 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37c697826064c738150ed7e2fc5aee3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.085830 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1339/2687] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:53 2022] DELETE /identity/v3/users/a37c697826064c738150ed7e2fc5aee3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:54.090247 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b842eb-ed51-440a-8c1f-b99291c23907 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:54.090532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b842eb-ed51-440a-8c1f-b99291c23907 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:54.090848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b842eb-ed51-440a-8c1f-b99291c23907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:54.109911 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-21b842eb-ed51-440a-8c1f-b99291c23907 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:54.111365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-21b842eb-ed51-440a-8c1f-b99291c23907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:54.168303 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1349/2688] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:54.177860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:54.179290 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:54.234178 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b488545-898f-4953-ad65-13f902f9e02a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:54.237831 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e446d7-9359-4a3b-a59c-439fdfe6f42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:54.238454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e446d7-9359-4a3b-a59c-439fdfe6f42b service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:54.238728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e446d7-9359-4a3b-a59c-439fdfe6f42b service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:54.239026 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e446d7-9359-4a3b-a59c-439fdfe6f42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:54.248570 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e446d7-9359-4a3b-a59c-439fdfe6f42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:54.249970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e446d7-9359-4a3b-a59c-439fdfe6f42b service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:54.259248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1340/2689] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:58:54.592546 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b842eb-ed51-440a-8c1f-b99291c23907 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:54.594586 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-21b842eb-ed51-440a-8c1f-b99291c23907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:54.607082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b842eb-ed51-440a-8c1f-b99291c23907 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:54.611918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:54.612765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:54.613048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:54.613322 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] PATH_INFO: `/v3/projects/5eb62ee7e4524ec2b67cfdb88d59cdee` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:54.614860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb62ee7e4524ec2b67cfdb88d59cdee)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:54.616899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:54.669366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb62ee7e4524ec2b67cfdb88d59cdee', 'request_id': 'req-d2a38045-d314-48cc-8c64-ce86b450c391'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.678396 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb62ee7e4524ec2b67cfdb88d59cdee', 'request_id': 'req-d2a38045-d314-48cc-8c64-ce86b450c391'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.688019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb62ee7e4524ec2b67cfdb88d59cdee', 'request_id': 'req-d2a38045-d314-48cc-8c64-ce86b450c391'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.701931 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] The token cache is being invalidate because project 5eb62ee7e4524ec2b67cfdb88d59cdee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:54.703267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.704317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.707427 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1350/2690] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:54 2022] DELETE /identity/v3/projects/5eb62ee7e4524ec2b67cfdb88d59cdee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:54.712307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e446d7-9359-4a3b-a59c-439fdfe6f42b service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:54.725914 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e446d7-9359-4a3b-a59c-439fdfe6f42b service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:54.806431 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f323e05-81d7-4c60-8876-433c14eb7c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:54.807414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323e05-81d7-4c60-8876-433c14eb7c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:54.807871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323e05-81d7-4c60-8876-433c14eb7c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:54.808222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323e05-81d7-4c60-8876-433c14eb7c7d admin admin] PATH_INFO: `/v3/users/9c6b30f42a6e4578a15e5e59abe99568` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:54.809515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f323e05-81d7-4c60-8876-433c14eb7c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6b30f42a6e4578a15e5e59abe99568)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:54.811682 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f323e05-81d7-4c60-8876-433c14eb7c7d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:54.875423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8f323e05-81d7-4c60-8876-433c14eb7c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6b30f42a6e4578a15e5e59abe99568'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.886053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8f323e05-81d7-4c60-8876-433c14eb7c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6b30f42a6e4578a15e5e59abe99568'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.893302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8f323e05-81d7-4c60-8876-433c14eb7c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6b30f42a6e4578a15e5e59abe99568'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.909687 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8f323e05-81d7-4c60-8876-433c14eb7c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6b30f42a6e4578a15e5e59abe99568'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.912404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-8f323e05-81d7-4c60-8876-433c14eb7c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6b30f42a6e4578a15e5e59abe99568'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:54.928864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1341/2691] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:54 2022] DELETE /identity/v3/users/9c6b30f42a6e4578a15e5e59abe99568 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:55.367962 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:55.369387 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:55.382813 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a38045-d314-48cc-8c64-ce86b450c391 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:55.442472 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:55.443434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:55.443715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:55.443992 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] PATH_INFO: `/v3/projects/ad773d955b574fbca23a5a0a438b1a03` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:55.445223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad773d955b574fbca23a5a0a438b1a03)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:55.447317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:55.496459 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad773d955b574fbca23a5a0a438b1a03', 'request_id': 'req-53c95f24-456e-42e7-ba54-ac994383b21c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:55.501679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad773d955b574fbca23a5a0a438b1a03', 'request_id': 'req-53c95f24-456e-42e7-ba54-ac994383b21c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:55.509012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad773d955b574fbca23a5a0a438b1a03', 'request_id': 'req-53c95f24-456e-42e7-ba54-ac994383b21c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:55.520197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] The token cache is being invalidate because project ad773d955b574fbca23a5a0a438b1a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:55.521074 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:55.521608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-53c95f24-456e-42e7-ba54-ac994383b21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:55.523172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1351/2692] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:55 2022] DELETE /identity/v3/projects/ad773d955b574fbca23a5a0a438b1a03 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:55.529001 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f5d49-0cde-4b89-a352-17947a193d10 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:55.529293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f5d49-0cde-4b89-a352-17947a193d10 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:55.529612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f5d49-0cde-4b89-a352-17947a193d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:55.548994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-1e3f5d49-0cde-4b89-a352-17947a193d10 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:55.550195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1e3f5d49-0cde-4b89-a352-17947a193d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:55.610230 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1342/2693] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:55.619189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9893d8-6077-43a0-bcd3-fe5219343971 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:55.619652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9893d8-6077-43a0-bcd3-fe5219343971 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:55.619749 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9893d8-6077-43a0-bcd3-fe5219343971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:55.637469 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-6d9893d8-6077-43a0-bcd3-fe5219343971 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:55.638675 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-6d9893d8-6077-43a0-bcd3-fe5219343971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:55.647647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1352/2694] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:55.651865 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f5d49-0cde-4b89-a352-17947a193d10 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:55.661904 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f5d49-0cde-4b89-a352-17947a193d10 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:55.666492 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215039da-48f9-478b-931e-13a1623d840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:55.667180 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215039da-48f9-478b-931e-13a1623d840c admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:55.667462 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215039da-48f9-478b-931e-13a1623d840c admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:55.667737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215039da-48f9-478b-931e-13a1623d840c admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:55.668478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215039da-48f9-478b-931e-13a1623d840c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:58:55.669035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215039da-48f9-478b-931e-13a1623d840c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:55.670613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215039da-48f9-478b-931e-13a1623d840c admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:55.683402 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1343/2695] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:58:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:58:55.687457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9893d8-6077-43a0-bcd3-fe5219343971 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:55.697804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9893d8-6077-43a0-bcd3-fe5219343971 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:55.702541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667d223-1871-48e0-a7f7-0b56bbd1036a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:55.703307 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667d223-1871-48e0-a7f7-0b56bbd1036a admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:55.703654 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667d223-1871-48e0-a7f7-0b56bbd1036a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:55.704019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667d223-1871-48e0-a7f7-0b56bbd1036a admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:55.704783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667d223-1871-48e0-a7f7-0b56bbd1036a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:55.706720 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667d223-1871-48e0-a7f7-0b56bbd1036a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:55.732761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1353/2696] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:55 2022] POST /identity/v3/projects => generated 386 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:55.736783 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215039da-48f9-478b-931e-13a1623d840c admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:55.747559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215039da-48f9-478b-931e-13a1623d840c admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:55.802841 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea260d-75c2-456b-9d68-ae92105cad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:55.803499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea260d-75c2-456b-9d68-ae92105cad63 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:55.803776 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea260d-75c2-456b-9d68-ae92105cad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:55.804048 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea260d-75c2-456b-9d68-ae92105cad63 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:55.804735 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea260d-75c2-456b-9d68-ae92105cad63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:55.806627 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea260d-75c2-456b-9d68-ae92105cad63 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:55.825870 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1344/2697] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:55 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:58:55.830048 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667d223-1871-48e0-a7f7-0b56bbd1036a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:55.840180 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667d223-1871-48e0-a7f7-0b56bbd1036a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:55.844864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82861f10-bb55-4cd6-ace2-cae6405cec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:55.845505 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82861f10-bb55-4cd6-ace2-cae6405cec9d admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:55.845790 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82861f10-bb55-4cd6-ace2-cae6405cec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:55.846065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82861f10-bb55-4cd6-ace2-cae6405cec9d admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:55.846831 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82861f10-bb55-4cd6-ace2-cae6405cec9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:55.848402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82861f10-bb55-4cd6-ace2-cae6405cec9d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:55.858470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1354/2698] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:55 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:55.862339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea260d-75c2-456b-9d68-ae92105cad63 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:55.872526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea260d-75c2-456b-9d68-ae92105cad63 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:55.877098 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366395d-82bf-4980-a21f-724a438f72da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:55.877742 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366395d-82bf-4980-a21f-724a438f72da admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:55.878028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366395d-82bf-4980-a21f-724a438f72da admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:55.878308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366395d-82bf-4980-a21f-724a438f72da admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:55.879082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366395d-82bf-4980-a21f-724a438f72da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:55.881242 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366395d-82bf-4980-a21f-724a438f72da admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:55.890774 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1345/2699] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:55 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:55.894704 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82861f10-bb55-4cd6-ace2-cae6405cec9d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:55.905085 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82861f10-bb55-4cd6-ace2-cae6405cec9d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:55.909699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2bc0d-e7c0-4c66-93f0-7f34b1b928c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:55.910559 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2bc0d-e7c0-4c66-93f0-7f34b1b928c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:55.910902 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2bc0d-e7c0-4c66-93f0-7f34b1b928c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:55.911181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2bc0d-e7c0-4c66-93f0-7f34b1b928c2 admin admin] PATH_INFO: `/v3/projects/d25f2a5252e2438685322608a9f3eb4a/users/f791f1bdf87b456bb3da3278a4c80b97/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:55.925607 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2bc0d-e7c0-4c66-93f0-7f34b1b928c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25f2a5252e2438685322608a9f3eb4a, user_id=f791f1bdf87b456bb3da3278a4c80b97, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:55.929063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2bc0d-e7c0-4c66-93f0-7f34b1b928c2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:55.945212 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1355/2700] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:55 2022] PUT /identity/v3/projects/d25f2a5252e2438685322608a9f3eb4a/users/f791f1bdf87b456bb3da3278a4c80b97/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:55.959726 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23161443-34c8-4e56-b104-3df4c4b1b845 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:55.960183 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23161443-34c8-4e56-b104-3df4c4b1b845 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:55.960488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23161443-34c8-4e56-b104-3df4c4b1b845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:55.987985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-23161443-34c8-4e56-b104-3df4c4b1b845 None None] MFA Rules not processed for user `f791f1bdf87b456bb3da3278a4c80b97`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:55.991523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-23161443-34c8-4e56-b104-3df4c4b1b845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:56.057454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1346/2701] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:56.067924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2bc0d-e7c0-4c66-93f0-7f34b1b928c2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:56.069649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d3a2bc0d-e7c0-4c66-93f0-7f34b1b928c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:56.127681 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2bc0d-e7c0-4c66-93f0-7f34b1b928c2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:56.131428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3357dad-4332-4fe1-8d20-82426b701d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:56.132063 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3357dad-4332-4fe1-8d20-82426b701d8e service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:56.132349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3357dad-4332-4fe1-8d20-82426b701d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:56.132625 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3357dad-4332-4fe1-8d20-82426b701d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:56.140930 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3357dad-4332-4fe1-8d20-82426b701d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:56.142341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3357dad-4332-4fe1-8d20-82426b701d8e service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:56.151249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1356/2702] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:56.171513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23161443-34c8-4e56-b104-3df4c4b1b845 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:56.233057 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23161443-34c8-4e56-b104-3df4c4b1b845 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:56.237525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:56.238375 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:56.238649 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:56.238959 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] PATH_INFO: `/v3/users/f791f1bdf87b456bb3da3278a4c80b97` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:56.241324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f791f1bdf87b456bb3da3278a4c80b97)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:56.243264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:56.285767 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f791f1bdf87b456bb3da3278a4c80b97'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:56.293185 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f791f1bdf87b456bb3da3278a4c80b97'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:56.300275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f791f1bdf87b456bb3da3278a4c80b97'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:56.313944 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f791f1bdf87b456bb3da3278a4c80b97'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:56.314635 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f791f1bdf87b456bb3da3278a4c80b97'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:56.323754 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1347/2703] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:56 2022] DELETE /identity/v3/users/f791f1bdf87b456bb3da3278a4c80b97 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:56.328226 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b67fe-b2ed-4883-959c-3f1055e0fb6e None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:56.328511 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b67fe-b2ed-4883-959c-3f1055e0fb6e None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:56.328783 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b67fe-b2ed-4883-959c-3f1055e0fb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:56.347050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-8a9b67fe-b2ed-4883-959c-3f1055e0fb6e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:56.348228 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8a9b67fe-b2ed-4883-959c-3f1055e0fb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:56.406819 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1357/2704] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:56.417258 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:56.419034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:56.478039 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47800ce2-569f-4a73-b13e-b7673e5c41a8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:56.482085 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654c1c9-1983-4a53-b04f-9d3204642f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:56.482838 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c1c9-1983-4a53-b04f-9d3204642f58 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:56.483229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c1c9-1983-4a53-b04f-9d3204642f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:56.483506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c1c9-1983-4a53-b04f-9d3204642f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:56.493291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654c1c9-1983-4a53-b04f-9d3204642f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:56.494711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654c1c9-1983-4a53-b04f-9d3204642f58 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:56.503979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1348/2705] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:56.791456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b67fe-b2ed-4883-959c-3f1055e0fb6e None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:56.792963 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8a9b67fe-b2ed-4883-959c-3f1055e0fb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:56.808637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b67fe-b2ed-4883-959c-3f1055e0fb6e None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:56.814081 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:56.815207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:56.815650 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:56.815921 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] PATH_INFO: `/v3/projects/d25f2a5252e2438685322608a9f3eb4a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:56.818326 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25f2a5252e2438685322608a9f3eb4a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:56.821697 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:56.889384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25f2a5252e2438685322608a9f3eb4a', 'request_id': 'req-965bf3d0-8681-4ade-91fc-27a67ebacf0a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:56.896722 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25f2a5252e2438685322608a9f3eb4a', 'request_id': 'req-965bf3d0-8681-4ade-91fc-27a67ebacf0a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:56.904431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25f2a5252e2438685322608a9f3eb4a', 'request_id': 'req-965bf3d0-8681-4ade-91fc-27a67ebacf0a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:56.920612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] The token cache is being invalidate because project d25f2a5252e2438685322608a9f3eb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:56.921140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:56.922493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-965bf3d0-8681-4ade-91fc-27a67ebacf0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:56.925280 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1358/2706] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:56 2022] DELETE /identity/v3/projects/d25f2a5252e2438685322608a9f3eb4a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:56.931271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a80e5-22a7-42ad-9c60-64b2be60006e None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:56.931760 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a80e5-22a7-42ad-9c60-64b2be60006e None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:56.931860 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a80e5-22a7-42ad-9c60-64b2be60006e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:56.953222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7b9a80e5-22a7-42ad-9c60-64b2be60006e None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:56.954439 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7b9a80e5-22a7-42ad-9c60-64b2be60006e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:57.021971 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1349/2707] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:57.029450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ee824-c225-411b-bc49-57906763db51 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:57.029729 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ee824-c225-411b-bc49-57906763db51 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:57.029998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ee824-c225-411b-bc49-57906763db51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:57.048708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-786ee824-c225-411b-bc49-57906763db51 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:57.049927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-786ee824-c225-411b-bc49-57906763db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:57.058082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1359/2708] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:57.062332 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a80e5-22a7-42ad-9c60-64b2be60006e None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:57.072241 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a80e5-22a7-42ad-9c60-64b2be60006e None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:57.076791 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0736fa1-c0b5-43e4-a4f0-9c74cd3311ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:57.077426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0736fa1-c0b5-43e4-a4f0-9c74cd3311ec admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:57.077710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0736fa1-c0b5-43e4-a4f0-9c74cd3311ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:57.077983 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0736fa1-c0b5-43e4-a4f0-9c74cd3311ec admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:57.078713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0736fa1-c0b5-43e4-a4f0-9c74cd3311ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:58:57.079049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0736fa1-c0b5-43e4-a4f0-9c74cd3311ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:57.080658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0736fa1-c0b5-43e4-a4f0-9c74cd3311ec admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:57.092817 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1350/2709] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:58:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:58:57.097236 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ee824-c225-411b-bc49-57906763db51 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:57.106288 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ee824-c225-411b-bc49-57906763db51 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:57.111268 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1611a-9496-49bb-b564-e36b37ef812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:57.111903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1611a-9496-49bb-b564-e36b37ef812d admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:57.112185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1611a-9496-49bb-b564-e36b37ef812d admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:57.112457 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1611a-9496-49bb-b564-e36b37ef812d admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:57.113173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1611a-9496-49bb-b564-e36b37ef812d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:57.115737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1611a-9496-49bb-b564-e36b37ef812d admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:57.142640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1360/2710] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:57 2022] POST /identity/v3/projects => generated 374 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:57.146782 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0736fa1-c0b5-43e4-a4f0-9c74cd3311ec admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:57.160897 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0736fa1-c0b5-43e4-a4f0-9c74cd3311ec admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:57.216171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ad885-83df-4c57-bd1c-dcc37a34b6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:57.216842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ad885-83df-4c57-bd1c-dcc37a34b6ae admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:57.217124 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ad885-83df-4c57-bd1c-dcc37a34b6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:57.217401 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ad885-83df-4c57-bd1c-dcc37a34b6ae admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:57.218101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ad885-83df-4c57-bd1c-dcc37a34b6ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:57.220027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ad885-83df-4c57-bd1c-dcc37a34b6ae admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:57.240393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1351/2711] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:57 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:57.244039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1611a-9496-49bb-b564-e36b37ef812d admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:57.254031 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1611a-9496-49bb-b564-e36b37ef812d admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:57.259569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba300ef-a66a-4477-8efa-73c27070b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:57.260223 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba300ef-a66a-4477-8efa-73c27070b5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:57.260504 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba300ef-a66a-4477-8efa-73c27070b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:57.260782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba300ef-a66a-4477-8efa-73c27070b5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:57.261515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba300ef-a66a-4477-8efa-73c27070b5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:57.263130 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba300ef-a66a-4477-8efa-73c27070b5a6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:57.273811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1361/2712] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:57 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:57.278064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ad885-83df-4c57-bd1c-dcc37a34b6ae admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:57.288842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ad885-83df-4c57-bd1c-dcc37a34b6ae admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:57.294647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7452c5a-0c7c-40ac-bf5d-aac7c52caf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:57.294647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452c5a-0c7c-40ac-bf5d-aac7c52caf3a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:57.295308 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452c5a-0c7c-40ac-bf5d-aac7c52caf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:57.295513 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452c5a-0c7c-40ac-bf5d-aac7c52caf3a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:57.296256 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7452c5a-0c7c-40ac-bf5d-aac7c52caf3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:57.297834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7452c5a-0c7c-40ac-bf5d-aac7c52caf3a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:57.310466 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1352/2713] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:57 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:58:57.315077 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba300ef-a66a-4477-8efa-73c27070b5a6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:57.331301 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba300ef-a66a-4477-8efa-73c27070b5a6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:57.337755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3e21d-b204-4831-a08f-9b0172f39218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:57.338610 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3e21d-b204-4831-a08f-9b0172f39218 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:57.341566 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3e21d-b204-4831-a08f-9b0172f39218 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:57.341939 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3e21d-b204-4831-a08f-9b0172f39218 admin admin] PATH_INFO: `/v3/projects/5de5f4b606c94ef5832a79599d6aef73/users/d79d9ed347a64ea0959758e492a9c3ae/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:57.358137 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3e21d-b204-4831-a08f-9b0172f39218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de5f4b606c94ef5832a79599d6aef73, user_id=d79d9ed347a64ea0959758e492a9c3ae, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:57.360855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3e21d-b204-4831-a08f-9b0172f39218 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:57.378220 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1362/2714] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:57 2022] PUT /identity/v3/projects/5de5f4b606c94ef5832a79599d6aef73/users/d79d9ed347a64ea0959758e492a9c3ae/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:57.391206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f7d3-bcd4-4912-a387-e7d59758d4e4 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:57.391732 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f7d3-bcd4-4912-a387-e7d59758d4e4 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:57.392011 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f7d3-bcd4-4912-a387-e7d59758d4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:57.421232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a9d1f7d3-bcd4-4912-a387-e7d59758d4e4 None None] MFA Rules not processed for user `d79d9ed347a64ea0959758e492a9c3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:57.422655 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a9d1f7d3-bcd4-4912-a387-e7d59758d4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:57.496677 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1353/2715] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:57.508015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3e21d-b204-4831-a08f-9b0172f39218 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:57.510275 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f6f3e21d-b204-4831-a08f-9b0172f39218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:57.584534 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3e21d-b204-4831-a08f-9b0172f39218 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:57.592988 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a8acb-6ff4-477c-a1c8-1b4e3a1932a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:57.593643 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a8acb-6ff4-477c-a1c8-1b4e3a1932a7 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:57.593924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a8acb-6ff4-477c-a1c8-1b4e3a1932a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:57.594199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a8acb-6ff4-477c-a1c8-1b4e3a1932a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:57.603964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a8acb-6ff4-477c-a1c8-1b4e3a1932a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:57.605377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a8acb-6ff4-477c-a1c8-1b4e3a1932a7 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:57.617437 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1363/2716] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:57.639042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1f7d3-bcd4-4912-a387-e7d59758d4e4 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:57.721283 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1f7d3-bcd4-4912-a387-e7d59758d4e4 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:57.729101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:57.729976 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:57.730264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:57.730545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] PATH_INFO: `/v3/users/d79d9ed347a64ea0959758e492a9c3ae` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:57.731818 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79d9ed347a64ea0959758e492a9c3ae)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:57.733744 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:57.794643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79d9ed347a64ea0959758e492a9c3ae'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:57.804158 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79d9ed347a64ea0959758e492a9c3ae'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:57.814576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79d9ed347a64ea0959758e492a9c3ae'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:57.830046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79d9ed347a64ea0959758e492a9c3ae'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:57.830867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79d9ed347a64ea0959758e492a9c3ae'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:57.838690 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1354/2717] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:57 2022] DELETE /identity/v3/users/d79d9ed347a64ea0959758e492a9c3ae => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:57.843528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118709da-80eb-4ad7-bb9c-f7dcedea239a None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:57.844451 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118709da-80eb-4ad7-bb9c-f7dcedea239a None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:57.844920 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118709da-80eb-4ad7-bb9c-f7dcedea239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:57.862596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-118709da-80eb-4ad7-bb9c-f7dcedea239a None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:57.864258 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-118709da-80eb-4ad7-bb9c-f7dcedea239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:57.937126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1364/2718] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:57.948143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:57.949630 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:58.005249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118709da-80eb-4ad7-bb9c-f7dcedea239a None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:58.006658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-118709da-80eb-4ad7-bb9c-f7dcedea239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:58.019746 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118709da-80eb-4ad7-bb9c-f7dcedea239a None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:58.022293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa1b79-4979-4c45-b48c-8fab080d39c8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:58.026201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:58.026535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0d87c-194f-46d4-a93f-93537e88a1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:58.027323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d87c-194f-46d4-a93f-93537e88a1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.027681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d87c-194f-46d4-a93f-93537e88a1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.027875 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.028080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d87c-194f-46d4-a93f-93537e88a1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.028456 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.028906 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] PATH_INFO: `/v3/users/98d5e1bab24842a695cb1ed8b130bba9` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.030391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d5e1bab24842a695cb1ed8b130bba9)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:58.038625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0d87c-194f-46d4-a93f-93537e88a1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:58.040102 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0d87c-194f-46d4-a93f-93537e88a1f1 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:58.043455 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:58.050568 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1355/2719] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:58.097842 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d5e1bab24842a695cb1ed8b130bba9'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.111730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d5e1bab24842a695cb1ed8b130bba9'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.112489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d5e1bab24842a695cb1ed8b130bba9'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.113234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d5e1bab24842a695cb1ed8b130bba9'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.121617 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d5e1bab24842a695cb1ed8b130bba9'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.144669 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1365/2720] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:58 2022] DELETE /identity/v3/users/98d5e1bab24842a695cb1ed8b130bba9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:58:58.149880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208656b6-e566-48f0-a476-8fe7eee13d88 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.150784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208656b6-e566-48f0-a476-8fe7eee13d88 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.150784 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208656b6-e566-48f0-a476-8fe7eee13d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.183532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-208656b6-e566-48f0-a476-8fe7eee13d88 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:58.184753 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-208656b6-e566-48f0-a476-8fe7eee13d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:58.253168 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1356/2721] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:58.265214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:58.266670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:58.337049 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f6fe8-f06f-46bd-8503-0a3aaa0f14cf admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:58.341263 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bc6c1-c76c-4be0-8ffc-a1dd7fbf5085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:58.341912 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bc6c1-c76c-4be0-8ffc-a1dd7fbf5085 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.342242 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bc6c1-c76c-4be0-8ffc-a1dd7fbf5085 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.342591 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bc6c1-c76c-4be0-8ffc-a1dd7fbf5085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.353468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bc6c1-c76c-4be0-8ffc-a1dd7fbf5085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:58.355080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208656b6-e566-48f0-a476-8fe7eee13d88 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:58.355580 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bc6c1-c76c-4be0-8ffc-a1dd7fbf5085 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:58.356622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-208656b6-e566-48f0-a476-8fe7eee13d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:58.367302 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1366/2722] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:58.376011 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208656b6-e566-48f0-a476-8fe7eee13d88 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:58.386305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:58.387509 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.387888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.388263 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] PATH_INFO: `/v3/projects/5de5f4b606c94ef5832a79599d6aef73` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.390200 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de5f4b606c94ef5832a79599d6aef73)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:58.392653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:58.451248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de5f4b606c94ef5832a79599d6aef73', 'request_id': 'req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.463834 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de5f4b606c94ef5832a79599d6aef73', 'request_id': 'req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.471101 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de5f4b606c94ef5832a79599d6aef73', 'request_id': 'req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.486202 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] The token cache is being invalidate because project 5de5f4b606c94ef5832a79599d6aef73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:58.486549 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.487390 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1a6346f7-509d-4bb9-bb6b-3ffc5ed79ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.490382 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1357/2723] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:58 2022] DELETE /identity/v3/projects/5de5f4b606c94ef5832a79599d6aef73 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:58.496184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d7db-5206-4edb-a728-e895cef08a49 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.496585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d7db-5206-4edb-a728-e895cef08a49 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.496975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d7db-5206-4edb-a728-e895cef08a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.517737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-c485d7db-5206-4edb-a728-e895cef08a49 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:58.519026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c485d7db-5206-4edb-a728-e895cef08a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:58.583047 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1367/2724] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:58.591169 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3895cf-be5f-4dda-81ba-08c3a98686c1 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.591459 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3895cf-be5f-4dda-81ba-08c3a98686c1 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.591743 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3895cf-be5f-4dda-81ba-08c3a98686c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.623127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-3d3895cf-be5f-4dda-81ba-08c3a98686c1 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:58.624351 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3d3895cf-be5f-4dda-81ba-08c3a98686c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:58.634460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1358/2725] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:58.638598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d7db-5206-4edb-a728-e895cef08a49 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:58.649365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d7db-5206-4edb-a728-e895cef08a49 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:58.655487 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7da48-042b-478b-b782-3928faa1e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:58.658930 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7da48-042b-478b-b782-3928faa1e156 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.658930 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7da48-042b-478b-b782-3928faa1e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.658930 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7da48-042b-478b-b782-3928faa1e156 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.658930 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7da48-042b-478b-b782-3928faa1e156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:58:58.658930 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7da48-042b-478b-b782-3928faa1e156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:58.660584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7da48-042b-478b-b782-3928faa1e156 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:58.674894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1368/2726] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:58:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:58:58.680126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3895cf-be5f-4dda-81ba-08c3a98686c1 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:58.687028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7da48-042b-478b-b782-3928faa1e156 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:58.688854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-90f7da48-042b-478b-b782-3928faa1e156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:58.691613 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3895cf-be5f-4dda-81ba-08c3a98686c1 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:58.697730 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda24138-c3f9-42de-862c-2686d986a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:58.698426 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda24138-c3f9-42de-862c-2686d986a585 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.698710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda24138-c3f9-42de-862c-2686d986a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.699078 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda24138-c3f9-42de-862c-2686d986a585 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.699792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda24138-c3f9-42de-862c-2686d986a585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:58.701807 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda24138-c3f9-42de-862c-2686d986a585 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:58.704978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7da48-042b-478b-b782-3928faa1e156 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:58.710693 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:58.711615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.711898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.712176 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] PATH_INFO: `/v3/projects/2dc3363c56f542a9a24568117c4ebc02` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.713416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dc3363c56f542a9a24568117c4ebc02)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:58.715420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:58.741278 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1359/2727] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:58 2022] POST /identity/v3/projects => generated 372 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:58.745760 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda24138-c3f9-42de-862c-2686d986a585 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:58.767689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dc3363c56f542a9a24568117c4ebc02', 'request_id': 'req-0834d7ca-75f6-4735-b783-34e372609c8c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.774152 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dc3363c56f542a9a24568117c4ebc02', 'request_id': 'req-0834d7ca-75f6-4735-b783-34e372609c8c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.783311 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dc3363c56f542a9a24568117c4ebc02', 'request_id': 'req-0834d7ca-75f6-4735-b783-34e372609c8c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.802335 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] The token cache is being invalidate because project 2dc3363c56f542a9a24568117c4ebc02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:58.802885 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.804014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.806633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1369/2728] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:58 2022] DELETE /identity/v3/projects/2dc3363c56f542a9a24568117c4ebc02 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:58.810543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:58.811914 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:58.838384 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda24138-c3f9-42de-862c-2686d986a585 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:58.879197 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834d7ca-75f6-4735-b783-34e372609c8c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:58.885238 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:58.886114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.886395 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.886673 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] PATH_INFO: `/v3/users/3976d0698b2d41b788284e74f553be42` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.887940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3976d0698b2d41b788284e74f553be42)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:58.889856 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:58.901416 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e8cd3-1321-424d-be2b-f418d0111c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:58.902097 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e8cd3-1321-424d-be2b-f418d0111c1b admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.902525 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e8cd3-1321-424d-be2b-f418d0111c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.902833 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e8cd3-1321-424d-be2b-f418d0111c1b admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.903543 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e8cd3-1321-424d-be2b-f418d0111c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:58.905985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e8cd3-1321-424d-be2b-f418d0111c1b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:58.931296 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1360/2729] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:58 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:58:58.936123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e8cd3-1321-424d-be2b-f418d0111c1b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:58.937845 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-073e8cd3-1321-424d-be2b-f418d0111c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:58.945634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3976d0698b2d41b788284e74f553be42'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.950248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e8cd3-1321-424d-be2b-f418d0111c1b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:58.955343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af023b8d-471e-42a5-afbb-f8c4c7caae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:58.956228 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af023b8d-471e-42a5-afbb-f8c4c7caae20 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:58.956357 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af023b8d-471e-42a5-afbb-f8c4c7caae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:58.956542 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af023b8d-471e-42a5-afbb-f8c4c7caae20 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:58.957281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af023b8d-471e-42a5-afbb-f8c4c7caae20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:58.957970 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3976d0698b2d41b788284e74f553be42'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.958686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3976d0698b2d41b788284e74f553be42'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.959078 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af023b8d-471e-42a5-afbb-f8c4c7caae20 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:58.959350 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3976d0698b2d41b788284e74f553be42'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.967671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3976d0698b2d41b788284e74f553be42'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:58.974155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1361/2730] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:58 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:58:58.976432 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af023b8d-471e-42a5-afbb-f8c4c7caae20 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:58.979997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-af023b8d-471e-42a5-afbb-f8c4c7caae20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:58.983649 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1370/2731] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:58:58 2022] DELETE /identity/v3/users/3976d0698b2d41b788284e74f553be42 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:58:58.993108 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af023b8d-471e-42a5-afbb-f8c4c7caae20 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:59.061194 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717341ab-09f7-48db-9d01-525204e2ee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:59.062215 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717341ab-09f7-48db-9d01-525204e2ee2b admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:59.062564 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717341ab-09f7-48db-9d01-525204e2ee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:59.062941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717341ab-09f7-48db-9d01-525204e2ee2b admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:59.063759 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717341ab-09f7-48db-9d01-525204e2ee2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:59.065408 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717341ab-09f7-48db-9d01-525204e2ee2b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:59.076524 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1362/2732] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:58:58 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:58:59.080803 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:59.094355 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e4198-4061-4ce6-87b8-58b99929885a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:59.099430 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437e6e0-a97e-41f4-9a0a-380c85c509d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:59.100497 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437e6e0-a97e-41f4-9a0a-380c85c509d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:59.100878 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437e6e0-a97e-41f4-9a0a-380c85c509d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:59.101219 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437e6e0-a97e-41f4-9a0a-380c85c509d4 admin admin] PATH_INFO: `/v3/projects/a2947438820e4664aa20c3c7b4aa57a4/users/818b5a37eb3c4883a044649c24f846d6/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:59.116945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437e6e0-a97e-41f4-9a0a-380c85c509d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2947438820e4664aa20c3c7b4aa57a4, user_id=818b5a37eb3c4883a044649c24f846d6, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:59.119876 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437e6e0-a97e-41f4-9a0a-380c85c509d4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:59.136552 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1371/2733] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:58:59 2022] PUT /identity/v3/projects/a2947438820e4664aa20c3c7b4aa57a4/users/818b5a37eb3c4883a044649c24f846d6/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:59.149331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ea08e-3210-41d6-869a-b25599ed7fcf None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:59.149628 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ea08e-3210-41d6-869a-b25599ed7fcf None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:59.149906 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ea08e-3210-41d6-869a-b25599ed7fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:59.184850 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-d69ea08e-3210-41d6-869a-b25599ed7fcf None None] MFA Rules not processed for user `818b5a37eb3c4883a044649c24f846d6`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:59.186068 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d69ea08e-3210-41d6-869a-b25599ed7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:59.257923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1363/2734] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:59.269545 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437e6e0-a97e-41f4-9a0a-380c85c509d4 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:59.272007 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4437e6e0-a97e-41f4-9a0a-380c85c509d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:59.327328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437e6e0-a97e-41f4-9a0a-380c85c509d4 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:59.331014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aaf08-49bb-4ad3-a516-c9149ae14df8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2691f7bb4ed84de4bb5901710a96d766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:59.331658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaf08-49bb-4ad3-a516-c9149ae14df8 service glance] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:59.331943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaf08-49bb-4ad3-a516-c9149ae14df8 service glance] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:59.332227 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaf08-49bb-4ad3-a516-c9149ae14df8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:59.341658 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aaf08-49bb-4ad3-a516-c9149ae14df8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:59.343116 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aaf08-49bb-4ad3-a516-c9149ae14df8 service glance] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:59.352168 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1372/2735] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:58:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:58:59.450281 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ea08e-3210-41d6-869a-b25599ed7fcf None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:59.452481 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d69ea08e-3210-41d6-869a-b25599ed7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:59.538640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ea08e-3210-41d6-869a-b25599ed7fcf None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:59.544288 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:59.545569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:59.546488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:59.546876 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] PATH_INFO: `/v3/projects/8f174819dbaf44b3bae04bd123dfe9de` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:59.548413 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f174819dbaf44b3bae04bd123dfe9de)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:59.551030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:59.600312 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f174819dbaf44b3bae04bd123dfe9de', 'request_id': 'req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:59.607542 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f174819dbaf44b3bae04bd123dfe9de', 'request_id': 'req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:59.613930 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f174819dbaf44b3bae04bd123dfe9de', 'request_id': 'req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:59.624314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] The token cache is being invalidate because project 8f174819dbaf44b3bae04bd123dfe9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:58:59.624603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:59.625244 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-62b9aa9e-8c01-4e22-a00b-63bc0e6406a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:58:59.626802 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1364/2736] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:58:59 2022] DELETE /identity/v3/projects/8f174819dbaf44b3bae04bd123dfe9de => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:58:59.632882 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768351b-3ec6-429e-a03f-9f0c7cab27ec None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:59.633163 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768351b-3ec6-429e-a03f-9f0c7cab27ec None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:59.633431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768351b-3ec6-429e-a03f-9f0c7cab27ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:59.651757 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-9768351b-3ec6-429e-a03f-9f0c7cab27ec None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:59.653011 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9768351b-3ec6-429e-a03f-9f0c7cab27ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:59.714052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1373/2737] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:59.721931 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c4964-4c41-4a11-b127-6143739e4693 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:59.722223 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c4964-4c41-4a11-b127-6143739e4693 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:59.722501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c4964-4c41-4a11-b127-6143739e4693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:59.742424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-aa1c4964-4c41-4a11-b127-6143739e4693 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:58:59.743666 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-aa1c4964-4c41-4a11-b127-6143739e4693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:58:59.751994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1365/2738] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:58:59.756576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768351b-3ec6-429e-a03f-9f0c7cab27ec None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:59.768489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768351b-3ec6-429e-a03f-9f0c7cab27ec None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:59.780913 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a539d21-0fd8-498e-b5be-d33618eb9e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:59.781582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a539d21-0fd8-498e-b5be-d33618eb9e27 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:59.781907 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a539d21-0fd8-498e-b5be-d33618eb9e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:59.782179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a539d21-0fd8-498e-b5be-d33618eb9e27 admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:59.783019 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a539d21-0fd8-498e-b5be-d33618eb9e27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:58:59.783321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a539d21-0fd8-498e-b5be-d33618eb9e27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:59.785163 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a539d21-0fd8-498e-b5be-d33618eb9e27 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:59.799088 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1374/2739] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:58:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:58:59.804392 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c4964-4c41-4a11-b127-6143739e4693 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:59.828988 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c4964-4c41-4a11-b127-6143739e4693 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:59.835470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944413-de63-4bac-831f-f6874740fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:59.836135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944413-de63-4bac-831f-f6874740fca4 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:59.836420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944413-de63-4bac-831f-f6874740fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:59.836696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944413-de63-4bac-831f-f6874740fca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:58:59.837407 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce944413-de63-4bac-831f-f6874740fca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:58:59.839358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce944413-de63-4bac-831f-f6874740fca4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:58:59.887105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1366/2740] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:58:59 2022] POST /identity/v3/projects => generated 372 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:58:59.891634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a539d21-0fd8-498e-b5be-d33618eb9e27 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:58:59.903601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a539d21-0fd8-498e-b5be-d33618eb9e27 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:58:59.996460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0826b5-acb3-4e04-9a5e-5849dd5f2b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:58:59.997562 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0826b5-acb3-4e04-9a5e-5849dd5f2b29 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:58:59.997945 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0826b5-acb3-4e04-9a5e-5849dd5f2b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:58:59.998324 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0826b5-acb3-4e04-9a5e-5849dd5f2b29 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.000313 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0826b5-acb3-4e04-9a5e-5849dd5f2b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:00.002863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0826b5-acb3-4e04-9a5e-5849dd5f2b29 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:00.032972 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1375/2741] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:58:59 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:59:00.033904 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944413-de63-4bac-831f-f6874740fca4 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:00.056522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944413-de63-4bac-831f-f6874740fca4 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:00.066067 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3e994-f0fe-4442-a462-7705012faf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:00.067508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e994-f0fe-4442-a462-7705012faf74 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.069080 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e994-f0fe-4442-a462-7705012faf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.069383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e994-f0fe-4442-a462-7705012faf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.070253 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3e994-f0fe-4442-a462-7705012faf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:00.072465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3e994-f0fe-4442-a462-7705012faf74 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:00.087143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1367/2742] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:00 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:59:00.091689 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0826b5-acb3-4e04-9a5e-5849dd5f2b29 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:00.101837 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0826b5-acb3-4e04-9a5e-5849dd5f2b29 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:00.106716 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f5f04-516f-4e9f-b465-9c4b1b6f6713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:00.107488 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f5f04-516f-4e9f-b465-9c4b1b6f6713 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.107833 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f5f04-516f-4e9f-b465-9c4b1b6f6713 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.108109 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f5f04-516f-4e9f-b465-9c4b1b6f6713 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.108843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f5f04-516f-4e9f-b465-9c4b1b6f6713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:00.110417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f5f04-516f-4e9f-b465-9c4b1b6f6713 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:00.121365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1376/2743] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:00 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:59:00.125552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3e994-f0fe-4442-a462-7705012faf74 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:00.136344 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3e994-f0fe-4442-a462-7705012faf74 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:00.141245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36d334-d720-4af1-92e1-6fa7cf7db8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:00.142162 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36d334-d720-4af1-92e1-6fa7cf7db8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.142577 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36d334-d720-4af1-92e1-6fa7cf7db8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.142905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36d334-d720-4af1-92e1-6fa7cf7db8bd admin admin] PATH_INFO: `/v3/projects/902de2361d32407b81e96f6825f7769a/users/6b496917e3c847b5ab4e9ef8dd79a4f3/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.161641 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36d334-d720-4af1-92e1-6fa7cf7db8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=902de2361d32407b81e96f6825f7769a, user_id=6b496917e3c847b5ab4e9ef8dd79a4f3, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:00.164489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36d334-d720-4af1-92e1-6fa7cf7db8bd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:00.181094 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1368/2744] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:00 2022] PUT /identity/v3/projects/902de2361d32407b81e96f6825f7769a/users/6b496917e3c847b5ab4e9ef8dd79a4f3/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:59:00.193393 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12523577-6e51-4b0d-9a19-09d7660f4048 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.193793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12523577-6e51-4b0d-9a19-09d7660f4048 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.194067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12523577-6e51-4b0d-9a19-09d7660f4048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.224235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-12523577-6e51-4b0d-9a19-09d7660f4048 None None] MFA Rules not processed for user `6b496917e3c847b5ab4e9ef8dd79a4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:00.225839 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-12523577-6e51-4b0d-9a19-09d7660f4048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:00.290349 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1377/2745] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:59:00.296994 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36d334-d720-4af1-92e1-6fa7cf7db8bd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:00.358480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36d334-d720-4af1-92e1-6fa7cf7db8bd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:00.363095 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c72319-4f73-4a39-b3c5-54183fc7d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:00.364320 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c72319-4f73-4a39-b3c5-54183fc7d410 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.364596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c72319-4f73-4a39-b3c5-54183fc7d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.364866 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c72319-4f73-4a39-b3c5-54183fc7d410 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.365555 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c72319-4f73-4a39-b3c5-54183fc7d410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:00.367449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c72319-4f73-4a39-b3c5-54183fc7d410 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:00.393759 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1369/2746] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:59:00 2022] POST /identity/v3/projects => generated 372 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:00.397894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12523577-6e51-4b0d-9a19-09d7660f4048 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:00.408496 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12523577-6e51-4b0d-9a19-09d7660f4048 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:00.464936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ee929-97da-41be-b14b-221571724a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:00.465612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee929-97da-41be-b14b-221571724a31 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.465895 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee929-97da-41be-b14b-221571724a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.466232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee929-97da-41be-b14b-221571724a31 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.466994 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ee929-97da-41be-b14b-221571724a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:00.468901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ee929-97da-41be-b14b-221571724a31 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:00.491987 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1378/2747] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:59:00 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:59:00.496266 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c72319-4f73-4a39-b3c5-54183fc7d410 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:00.506214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c72319-4f73-4a39-b3c5-54183fc7d410 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:00.510842 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e0d2-99da-416b-9726-eba2ec884c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:00.511488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e0d2-99da-416b-9726-eba2ec884c07 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.511768 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e0d2-99da-416b-9726-eba2ec884c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.512042 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e0d2-99da-416b-9726-eba2ec884c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.512773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278e0d2-99da-416b-9726-eba2ec884c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:00.514348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278e0d2-99da-416b-9726-eba2ec884c07 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:00.524855 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1370/2748] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:00 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:00.529151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ee929-97da-41be-b14b-221571724a31 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:00.540133 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ee929-97da-41be-b14b-221571724a31 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:00.544915 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37099688-c536-4179-b89a-908d6f847147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:00.545781 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37099688-c536-4179-b89a-908d6f847147 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.546061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37099688-c536-4179-b89a-908d6f847147 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.546339 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37099688-c536-4179-b89a-908d6f847147 admin admin] PATH_INFO: `/v3/projects/80caf9aa8b274f6eb57b37d92c8f790c/users/c6d3355d9c684f808432c139e8d7cd5c/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.561444 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37099688-c536-4179-b89a-908d6f847147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80caf9aa8b274f6eb57b37d92c8f790c, user_id=c6d3355d9c684f808432c139e8d7cd5c, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:00.564095 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37099688-c536-4179-b89a-908d6f847147 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:00.578648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1379/2749] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:00 2022] PUT /identity/v3/projects/80caf9aa8b274f6eb57b37d92c8f790c/users/c6d3355d9c684f808432c139e8d7cd5c/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:59:00.582533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e0d2-99da-416b-9726-eba2ec884c07 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:00.592465 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e0d2-99da-416b-9726-eba2ec884c07 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:00.651342 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23deece-3575-4b55-b03f-18b17bdca868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:00.651936 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23deece-3575-4b55-b03f-18b17bdca868 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.652318 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23deece-3575-4b55-b03f-18b17bdca868 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.652578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23deece-3575-4b55-b03f-18b17bdca868 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.653325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23deece-3575-4b55-b03f-18b17bdca868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:00.654953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23deece-3575-4b55-b03f-18b17bdca868 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:00.665731 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1371/2750] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:00 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:59:00.670417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37099688-c536-4179-b89a-908d6f847147 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:00.681889 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37099688-c536-4179-b89a-908d6f847147 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:00.687200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8aace0-6142-4d05-8829-cab6c51de548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:00.688086 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aace0-6142-4d05-8829-cab6c51de548 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.688366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aace0-6142-4d05-8829-cab6c51de548 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.688644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aace0-6142-4d05-8829-cab6c51de548 admin admin] PATH_INFO: `/v3/projects/80caf9aa8b274f6eb57b37d92c8f790c/users/c6d3355d9c684f808432c139e8d7cd5c/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.690665 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8aace0-6142-4d05-8829-cab6c51de548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80caf9aa8b274f6eb57b37d92c8f790c, user_id=c6d3355d9c684f808432c139e8d7cd5c, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:00.693514 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8aace0-6142-4d05-8829-cab6c51de548 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:00.704523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1380/2751] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:00 2022] PUT /identity/v3/projects/80caf9aa8b274f6eb57b37d92c8f790c/users/c6d3355d9c684f808432c139e8d7cd5c/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:00.715181 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93905-afa6-41fe-8703-4b14742aab6d None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.715476 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93905-afa6-41fe-8703-4b14742aab6d None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.715800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93905-afa6-41fe-8703-4b14742aab6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.746115 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a4c93905-afa6-41fe-8703-4b14742aab6d None None] MFA Rules not processed for user `c6d3355d9c684f808432c139e8d7cd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:00.747366 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a4c93905-afa6-41fe-8703-4b14742aab6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:00.817629 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1372/2752] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:00.828940 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8aace0-6142-4d05-8829-cab6c51de548 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:00.830154 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-0b8aace0-6142-4d05-8829-cab6c51de548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:00.887271 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8aace0-6142-4d05-8829-cab6c51de548 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:00.891296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9dfed5-b970-412e-a3de-46aacf69695a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:00.891928 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dfed5-b970-412e-a3de-46aacf69695a service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:00.892484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dfed5-b970-412e-a3de-46aacf69695a service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:00.892484 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dfed5-b970-412e-a3de-46aacf69695a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:00.903097 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9dfed5-b970-412e-a3de-46aacf69695a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:00.904445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9dfed5-b970-412e-a3de-46aacf69695a service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:00.914648 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1381/2753] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:01.277741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c93905-afa6-41fe-8703-4b14742aab6d None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:01.339958 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c93905-afa6-41fe-8703-4b14742aab6d None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:01.344461 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:01.345315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:01.345599 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:01.345874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] PATH_INFO: `/v3/users/6b496917e3c847b5ab4e9ef8dd79a4f3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:01.347099 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b496917e3c847b5ab4e9ef8dd79a4f3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:01.349651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:01.397675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b496917e3c847b5ab4e9ef8dd79a4f3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:01.405316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b496917e3c847b5ab4e9ef8dd79a4f3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:01.412922 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b496917e3c847b5ab4e9ef8dd79a4f3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:01.424286 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b496917e3c847b5ab4e9ef8dd79a4f3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:01.424926 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b496917e3c847b5ab4e9ef8dd79a4f3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:01.430654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1373/2754] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:59:01 2022] DELETE /identity/v3/users/6b496917e3c847b5ab4e9ef8dd79a4f3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:01.435122 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680ed4-f82f-4f4d-b5bb-646dd7cbe88b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:01.435410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680ed4-f82f-4f4d-b5bb-646dd7cbe88b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:01.435684 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680ed4-f82f-4f4d-b5bb-646dd7cbe88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:01.455014 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-fb680ed4-f82f-4f4d-b5bb-646dd7cbe88b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:01.456199 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-fb680ed4-f82f-4f4d-b5bb-646dd7cbe88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:01.528852 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1382/2755] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:01.538956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:01.540348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:01.600741 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef629c-be33-471a-aa69-fc746988f05b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:01.604415 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92167557-d25e-4d03-a99c-be2339cfd18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:01.605051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92167557-d25e-4d03-a99c-be2339cfd18c service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:01.605330 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92167557-d25e-4d03-a99c-be2339cfd18c service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:01.605630 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92167557-d25e-4d03-a99c-be2339cfd18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:01.615454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92167557-d25e-4d03-a99c-be2339cfd18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:01.616880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92167557-d25e-4d03-a99c-be2339cfd18c service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:01.626171 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1374/2756] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:01.993112 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680ed4-f82f-4f4d-b5bb-646dd7cbe88b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:01.994857 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-fb680ed4-f82f-4f4d-b5bb-646dd7cbe88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:02.006343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680ed4-f82f-4f4d-b5bb-646dd7cbe88b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:02.010958 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:02.011796 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:02.012080 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:02.012353 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] PATH_INFO: `/v3/projects/902de2361d32407b81e96f6825f7769a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:02.013536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902de2361d32407b81e96f6825f7769a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:02.015442 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:02.064593 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902de2361d32407b81e96f6825f7769a', 'request_id': 'req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.070383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902de2361d32407b81e96f6825f7769a', 'request_id': 'req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.078436 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902de2361d32407b81e96f6825f7769a', 'request_id': 'req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.090066 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] The token cache is being invalidate because project 902de2361d32407b81e96f6825f7769a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:59:02.090356 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.091001 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.092509 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1383/2757] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:59:01 2022] DELETE /identity/v3/projects/902de2361d32407b81e96f6825f7769a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:02.096577 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92167557-d25e-4d03-a99c-be2339cfd18c service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:02.107013 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92167557-d25e-4d03-a99c-be2339cfd18c service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:02.165293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e586ad1-c251-4894-96da-8b00e54ffd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:02.166165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586ad1-c251-4894-96da-8b00e54ffd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:02.166443 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586ad1-c251-4894-96da-8b00e54ffd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:02.166715 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586ad1-c251-4894-96da-8b00e54ffd83 admin admin] PATH_INFO: `/v3/users/c6d3355d9c684f808432c139e8d7cd5c` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:02.167967 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e586ad1-c251-4894-96da-8b00e54ffd83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d3355d9c684f808432c139e8d7cd5c)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:02.170161 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e586ad1-c251-4894-96da-8b00e54ffd83 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:02.218787 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2e586ad1-c251-4894-96da-8b00e54ffd83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d3355d9c684f808432c139e8d7cd5c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.227620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2e586ad1-c251-4894-96da-8b00e54ffd83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d3355d9c684f808432c139e8d7cd5c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.235480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2e586ad1-c251-4894-96da-8b00e54ffd83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d3355d9c684f808432c139e8d7cd5c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.252482 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2e586ad1-c251-4894-96da-8b00e54ffd83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d3355d9c684f808432c139e8d7cd5c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.253260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2e586ad1-c251-4894-96da-8b00e54ffd83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d3355d9c684f808432c139e8d7cd5c'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.260772 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1375/2758] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:59:02 2022] DELETE /identity/v3/users/c6d3355d9c684f808432c139e8d7cd5c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:02.544793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:02.546278 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:02.559668 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4914b2-fcc5-46e4-a93e-4c8be9185f15 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:02.618957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:02.619849 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:02.620128 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:02.620402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] PATH_INFO: `/v3/projects/80caf9aa8b274f6eb57b37d92c8f790c` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:02.621641 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80caf9aa8b274f6eb57b37d92c8f790c)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:02.623609 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:02.673294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80caf9aa8b274f6eb57b37d92c8f790c', 'request_id': 'req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.678675 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80caf9aa8b274f6eb57b37d92c8f790c', 'request_id': 'req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.686009 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80caf9aa8b274f6eb57b37d92c8f790c', 'request_id': 'req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.697612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] The token cache is being invalidate because project 80caf9aa8b274f6eb57b37d92c8f790c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:59:02.697900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.698569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-c4b40230-69e3-42f9-82b2-6ff3f2c7195f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:02.700214 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1384/2759] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:59:02 2022] DELETE /identity/v3/projects/80caf9aa8b274f6eb57b37d92c8f790c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:02.706367 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320498e2-f58a-4fc2-b9a5-03f6a4c9afc4 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:02.706947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320498e2-f58a-4fc2-b9a5-03f6a4c9afc4 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:02.706947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320498e2-f58a-4fc2-b9a5-03f6a4c9afc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:02.726664 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-320498e2-f58a-4fc2-b9a5-03f6a4c9afc4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:02.727875 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-320498e2-f58a-4fc2-b9a5-03f6a4c9afc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:02.789224 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1376/2760] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:02.798576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d782865-2733-4873-bb22-2acc806f1f6d None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:02.798899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d782865-2733-4873-bb22-2acc806f1f6d None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:02.799173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d782865-2733-4873-bb22-2acc806f1f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:02.817620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-5d782865-2733-4873-bb22-2acc806f1f6d None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:02.818814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-5d782865-2733-4873-bb22-2acc806f1f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:02.826706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1385/2761] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:02.831027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320498e2-f58a-4fc2-b9a5-03f6a4c9afc4 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:02.841471 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320498e2-f58a-4fc2-b9a5-03f6a4c9afc4 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:02.846082 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816b129-952a-4832-a5e8-f68c246edac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:02.846730 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816b129-952a-4832-a5e8-f68c246edac3 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:02.847045 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816b129-952a-4832-a5e8-f68c246edac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:02.847319 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816b129-952a-4832-a5e8-f68c246edac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:02.848316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816b129-952a-4832-a5e8-f68c246edac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:59:02.848780 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816b129-952a-4832-a5e8-f68c246edac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:02.850216 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816b129-952a-4832-a5e8-f68c246edac3 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:02.861429 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1377/2762] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:59:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:59:02.865900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d782865-2733-4873-bb22-2acc806f1f6d None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:02.874978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d782865-2733-4873-bb22-2acc806f1f6d None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:02.880177 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2e2ea-365d-4326-91c1-e73623d8d37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:02.880844 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2e2ea-365d-4326-91c1-e73623d8d37c admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:02.881131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2e2ea-365d-4326-91c1-e73623d8d37c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:02.881402 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2e2ea-365d-4326-91c1-e73623d8d37c admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:02.882102 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2e2ea-365d-4326-91c1-e73623d8d37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:02.884022 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2e2ea-365d-4326-91c1-e73623d8d37c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:02.910171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1386/2763] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:59:02 2022] POST /identity/v3/projects => generated 386 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:02.913992 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816b129-952a-4832-a5e8-f68c246edac3 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:02.924374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816b129-952a-4832-a5e8-f68c246edac3 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:02.987563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676dd4f-b785-433f-b952-e925ab68bf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:02.988260 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676dd4f-b785-433f-b952-e925ab68bf54 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:02.988633 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676dd4f-b785-433f-b952-e925ab68bf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:02.989397 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676dd4f-b785-433f-b952-e925ab68bf54 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:02.990127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676dd4f-b785-433f-b952-e925ab68bf54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:02.992064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676dd4f-b785-433f-b952-e925ab68bf54 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.011371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1378/2764] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:59:02 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:03.016041 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2e2ea-365d-4326-91c1-e73623d8d37c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.027585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2e2ea-365d-4326-91c1-e73623d8d37c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.032207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d4934-6d74-438b-9f09-ca9df673b0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.032860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4934-6d74-438b-9f09-ca9df673b0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.033141 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4934-6d74-438b-9f09-ca9df673b0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.033414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4934-6d74-438b-9f09-ca9df673b0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.034150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d4934-6d74-438b-9f09-ca9df673b0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.036298 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d4934-6d74-438b-9f09-ca9df673b0f4 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.047281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1387/2765] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:03 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:59:03.052006 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676dd4f-b785-433f-b952-e925ab68bf54 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.062309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676dd4f-b785-433f-b952-e925ab68bf54 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.068160 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2da65-01a1-4076-b0d9-c05df7278eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.068993 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2da65-01a1-4076-b0d9-c05df7278eaf admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.069356 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2da65-01a1-4076-b0d9-c05df7278eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.069636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2da65-01a1-4076-b0d9-c05df7278eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.070424 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2da65-01a1-4076-b0d9-c05df7278eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.072092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2da65-01a1-4076-b0d9-c05df7278eaf admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.083773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1379/2766] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:03 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:03.087267 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d4934-6d74-438b-9f09-ca9df673b0f4 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.097371 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d4934-6d74-438b-9f09-ca9df673b0f4 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.103136 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfaf90-e616-4e02-9190-bcce728e07b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.104296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfaf90-e616-4e02-9190-bcce728e07b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.104581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfaf90-e616-4e02-9190-bcce728e07b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.104858 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfaf90-e616-4e02-9190-bcce728e07b6 admin admin] PATH_INFO: `/v3/projects/fcf9cc26884a4b0cb96fd77c61e53ebe/users/bf102e2dd0ac4e16a4cee7b13184dc27/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.120608 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfaf90-e616-4e02-9190-bcce728e07b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf9cc26884a4b0cb96fd77c61e53ebe, user_id=bf102e2dd0ac4e16a4cee7b13184dc27, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.123297 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfaf90-e616-4e02-9190-bcce728e07b6 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.138836 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1388/2767] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:03 2022] PUT /identity/v3/projects/fcf9cc26884a4b0cb96fd77c61e53ebe/users/bf102e2dd0ac4e16a4cee7b13184dc27/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:03.148014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2393aa-70d9-4543-acc6-6e4bf8742ac3 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.148322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2393aa-70d9-4543-acc6-6e4bf8742ac3 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.148571 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2393aa-70d9-4543-acc6-6e4bf8742ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.178662 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7a2393aa-70d9-4543-acc6-6e4bf8742ac3 None None] MFA Rules not processed for user `bf102e2dd0ac4e16a4cee7b13184dc27`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:03.179905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7a2393aa-70d9-4543-acc6-6e4bf8742ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:03.250456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1380/2768] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:59:03.255816 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfaf90-e616-4e02-9190-bcce728e07b6 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.317613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfaf90-e616-4e02-9190-bcce728e07b6 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.322240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c711d4-dc56-4e2a-9ebe-c0aed717a198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.322916 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c711d4-dc56-4e2a-9ebe-c0aed717a198 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.323198 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c711d4-dc56-4e2a-9ebe-c0aed717a198 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.323471 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c711d4-dc56-4e2a-9ebe-c0aed717a198 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.324166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c711d4-dc56-4e2a-9ebe-c0aed717a198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.326028 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c711d4-dc56-4e2a-9ebe-c0aed717a198 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.350995 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1389/2769] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:59:03 2022] POST /identity/v3/projects => generated 386 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:59:03.355081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2393aa-70d9-4543-acc6-6e4bf8742ac3 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.366119 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2393aa-70d9-4543-acc6-6e4bf8742ac3 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.425261 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5af70c-4297-4783-ae55-49277ecb1997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.426474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af70c-4297-4783-ae55-49277ecb1997 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.426972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af70c-4297-4783-ae55-49277ecb1997 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.427311 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af70c-4297-4783-ae55-49277ecb1997 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.428047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5af70c-4297-4783-ae55-49277ecb1997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.429981 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5af70c-4297-4783-ae55-49277ecb1997 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.451468 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1381/2770] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:59:03 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:59:03.455533 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c711d4-dc56-4e2a-9ebe-c0aed717a198 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.468100 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c711d4-dc56-4e2a-9ebe-c0aed717a198 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.472718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1d061-53bb-4b17-bda2-8a644c43e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.473938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1d061-53bb-4b17-bda2-8a644c43e0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.474216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1d061-53bb-4b17-bda2-8a644c43e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.474486 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1d061-53bb-4b17-bda2-8a644c43e0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.475246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1d061-53bb-4b17-bda2-8a644c43e0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.476815 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1d061-53bb-4b17-bda2-8a644c43e0c5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.487454 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1390/2771] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:03 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:03.492393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5af70c-4297-4783-ae55-49277ecb1997 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.502452 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5af70c-4297-4783-ae55-49277ecb1997 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.507327 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2c32f-c151-4e66-a66e-4da0b3be3c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.507979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2c32f-c151-4e66-a66e-4da0b3be3c86 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.508268 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2c32f-c151-4e66-a66e-4da0b3be3c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.508535 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2c32f-c151-4e66-a66e-4da0b3be3c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.509269 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2c32f-c151-4e66-a66e-4da0b3be3c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.510888 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2c32f-c151-4e66-a66e-4da0b3be3c86 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.525251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1382/2772] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:03 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:03.529390 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1d061-53bb-4b17-bda2-8a644c43e0c5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.539811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1d061-53bb-4b17-bda2-8a644c43e0c5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.544720 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f9bea-5977-4570-bba6-075fb9128b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.545592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9bea-5977-4570-bba6-075fb9128b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.545882 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9bea-5977-4570-bba6-075fb9128b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.546161 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9bea-5977-4570-bba6-075fb9128b19 admin admin] PATH_INFO: `/v3/projects/86d139acebb947cf86e58bc0564f142f/users/353b928980d9465daa516d66bb189cb6/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.561585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f9bea-5977-4570-bba6-075fb9128b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d139acebb947cf86e58bc0564f142f, user_id=353b928980d9465daa516d66bb189cb6, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.564284 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f9bea-5977-4570-bba6-075fb9128b19 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.579680 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1391/2773] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:03 2022] PUT /identity/v3/projects/86d139acebb947cf86e58bc0564f142f/users/353b928980d9465daa516d66bb189cb6/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:59:03.590014 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5a37a-888e-4c83-a6b3-66abd853f47d None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.590303 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5a37a-888e-4c83-a6b3-66abd853f47d None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.590594 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5a37a-888e-4c83-a6b3-66abd853f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.617374 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a9a5a37a-888e-4c83-a6b3-66abd853f47d None None] MFA Rules not processed for user `353b928980d9465daa516d66bb189cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:03.618575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a9a5a37a-888e-4c83-a6b3-66abd853f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:03.683317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1383/2774] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:03.687800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f9bea-5977-4570-bba6-075fb9128b19 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.747386 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f9bea-5977-4570-bba6-075fb9128b19 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.752000 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca5f0e-265e-424f-8e65-43d658b6fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.752644 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca5f0e-265e-424f-8e65-43d658b6fb8c admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.752927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca5f0e-265e-424f-8e65-43d658b6fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.753202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca5f0e-265e-424f-8e65-43d658b6fb8c admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.753909 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca5f0e-265e-424f-8e65-43d658b6fb8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.756519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca5f0e-265e-424f-8e65-43d658b6fb8c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.782844 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1392/2775] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:59:03 2022] POST /identity/v3/projects => generated 388 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:03.787454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5a37a-888e-4c83-a6b3-66abd853f47d None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.798879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5a37a-888e-4c83-a6b3-66abd853f47d None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.856029 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57f10-ab99-4bda-8d5e-be44d4a824e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.856666 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57f10-ab99-4bda-8d5e-be44d4a824e5 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.856942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57f10-ab99-4bda-8d5e-be44d4a824e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.857309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57f10-ab99-4bda-8d5e-be44d4a824e5 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.858034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e57f10-ab99-4bda-8d5e-be44d4a824e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.859966 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e57f10-ab99-4bda-8d5e-be44d4a824e5 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.879980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1384/2776] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:59:03 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:59:03.884428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca5f0e-265e-424f-8e65-43d658b6fb8c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.894439 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca5f0e-265e-424f-8e65-43d658b6fb8c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.900726 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6874d-d430-42b3-95c7-6b3fee612335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.901378 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6874d-d430-42b3-95c7-6b3fee612335 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.901660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6874d-d430-42b3-95c7-6b3fee612335 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.901943 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6874d-d430-42b3-95c7-6b3fee612335 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.902677 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6874d-d430-42b3-95c7-6b3fee612335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.904285 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6874d-d430-42b3-95c7-6b3fee612335 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.916025 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1393/2777] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:03 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:03.920705 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57f10-ab99-4bda-8d5e-be44d4a824e5 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.931210 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57f10-ab99-4bda-8d5e-be44d4a824e5 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:03.935826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c23cc-213a-4bc6-a334-4cef38551315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:03.936702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c23cc-213a-4bc6-a334-4cef38551315 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:03.936977 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c23cc-213a-4bc6-a334-4cef38551315 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:03.937246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c23cc-213a-4bc6-a334-4cef38551315 admin admin] PATH_INFO: `/v3/projects/9a84ed048c9848f5ab2d8878cec1cb9d/users/cffbde4669064512870c3a6830b4787f/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:03.951987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c23cc-213a-4bc6-a334-4cef38551315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a84ed048c9848f5ab2d8878cec1cb9d, user_id=cffbde4669064512870c3a6830b4787f, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:03.954455 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c23cc-213a-4bc6-a334-4cef38551315 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:03.971019 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1385/2778] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:03 2022] PUT /identity/v3/projects/9a84ed048c9848f5ab2d8878cec1cb9d/users/cffbde4669064512870c3a6830b4787f/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:59:03.975793 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6874d-d430-42b3-95c7-6b3fee612335 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:03.985794 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6874d-d430-42b3-95c7-6b3fee612335 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:04.044937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaeb05e-8c35-4a04-ab46-2ca116417fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:04.045761 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeb05e-8c35-4a04-ab46-2ca116417fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:04.046039 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeb05e-8c35-4a04-ab46-2ca116417fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:04.046316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeb05e-8c35-4a04-ab46-2ca116417fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:04.047205 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaeb05e-8c35-4a04-ab46-2ca116417fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:04.048659 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaeb05e-8c35-4a04-ab46-2ca116417fc9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:04.061016 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1394/2779] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:03 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:59:04.063455 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c23cc-213a-4bc6-a334-4cef38551315 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:04.075394 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c23cc-213a-4bc6-a334-4cef38551315 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:04.080044 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed702df-707a-4bf6-9df3-ad3489b808c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:04.080920 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed702df-707a-4bf6-9df3-ad3489b808c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:04.081223 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed702df-707a-4bf6-9df3-ad3489b808c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:04.081528 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed702df-707a-4bf6-9df3-ad3489b808c1 admin admin] PATH_INFO: `/v3/projects/9a84ed048c9848f5ab2d8878cec1cb9d/users/cffbde4669064512870c3a6830b4787f/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:04.086279 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed702df-707a-4bf6-9df3-ad3489b808c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a84ed048c9848f5ab2d8878cec1cb9d, user_id=cffbde4669064512870c3a6830b4787f, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:04.088911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed702df-707a-4bf6-9df3-ad3489b808c1 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:04.101196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1386/2780] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:04 2022] PUT /identity/v3/projects/9a84ed048c9848f5ab2d8878cec1cb9d/users/cffbde4669064512870c3a6830b4787f/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:04.112834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8159-d39e-4431-8de5-9ece15deb845 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:04.113069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8159-d39e-4431-8de5-9ece15deb845 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:04.113306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8159-d39e-4431-8de5-9ece15deb845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:04.142417 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-d5fa8159-d39e-4431-8de5-9ece15deb845 None None] MFA Rules not processed for user `cffbde4669064512870c3a6830b4787f`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:04.143528 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d5fa8159-d39e-4431-8de5-9ece15deb845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:04.216516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1395/2781] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:04.226737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed702df-707a-4bf6-9df3-ad3489b808c1 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:04.228490 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-9ed702df-707a-4bf6-9df3-ad3489b808c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:04.290880 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed702df-707a-4bf6-9df3-ad3489b808c1 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:04.294964 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20fbfd-9ea4-4c6d-99d2-f39093653430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:04.295616 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fbfd-9ea4-4c6d-99d2-f39093653430 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:04.295901 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fbfd-9ea4-4c6d-99d2-f39093653430 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:04.296181 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fbfd-9ea4-4c6d-99d2-f39093653430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:04.306060 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20fbfd-9ea4-4c6d-99d2-f39093653430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:04.307555 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20fbfd-9ea4-4c6d-99d2-f39093653430 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:04.318711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1387/2782] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:04.797468 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa8159-d39e-4431-8de5-9ece15deb845 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:04.798879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-d5fa8159-d39e-4431-8de5-9ece15deb845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:04.810782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa8159-d39e-4431-8de5-9ece15deb845 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:04.814250 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eba077-ca2f-415b-9db8-cb037caa5e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:04.814901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba077-ca2f-415b-9db8-cb037caa5e7b service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:04.815181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba077-ca2f-415b-9db8-cb037caa5e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:04.815452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba077-ca2f-415b-9db8-cb037caa5e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:04.871041 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eba077-ca2f-415b-9db8-cb037caa5e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:04.872465 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eba077-ca2f-415b-9db8-cb037caa5e7b service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:04.881998 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1396/2783] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:08.848147 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20fbfd-9ea4-4c6d-99d2-f39093653430 service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:08.856440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20fbfd-9ea4-4c6d-99d2-f39093653430 service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:08.860639 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a61668-8dbe-4302-a775-069fc48535d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:08.861480 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61668-8dbe-4302-a775-069fc48535d2 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:08.861762 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61668-8dbe-4302-a775-069fc48535d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:08.862036 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61668-8dbe-4302-a775-069fc48535d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:08.925591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a61668-8dbe-4302-a775-069fc48535d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:08.926955 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a61668-8dbe-4302-a775-069fc48535d2 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:08.936163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1388/2784] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:11.043702 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eba077-ca2f-415b-9db8-cb037caa5e7b service cinder] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:11.108864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eba077-ca2f-415b-9db8-cb037caa5e7b service cinder] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:11.114523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:11.115640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:11.115925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:11.116202 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] PATH_INFO: `/v3/users/bf102e2dd0ac4e16a4cee7b13184dc27` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:11.117428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf102e2dd0ac4e16a4cee7b13184dc27)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:11.119530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:11.171507 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf102e2dd0ac4e16a4cee7b13184dc27'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.185614 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf102e2dd0ac4e16a4cee7b13184dc27'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.186419 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf102e2dd0ac4e16a4cee7b13184dc27'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.187170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf102e2dd0ac4e16a4cee7b13184dc27'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.196172 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf102e2dd0ac4e16a4cee7b13184dc27'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.211495 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1397/2785] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:59:11 2022] DELETE /identity/v3/users/bf102e2dd0ac4e16a4cee7b13184dc27 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:11.216223 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c80d82-af45-4ced-9d75-d6b8157bc7c0 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:11.216756 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c80d82-af45-4ced-9d75-d6b8157bc7c0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:11.216878 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c80d82-af45-4ced-9d75-d6b8157bc7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:11.236271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-58c80d82-af45-4ced-9d75-d6b8157bc7c0 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:11.237575 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-58c80d82-af45-4ced-9d75-d6b8157bc7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:11.301545 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1389/2786] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:59:11.308232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:11.309656 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:11.369549 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2bfbb-6e71-43b8-abac-f9128402b427 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:11.373207 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ba45e-3b94-4abb-b9e6-a15aa9469865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:11.373850 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ba45e-3b94-4abb-b9e6-a15aa9469865 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:11.374124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ba45e-3b94-4abb-b9e6-a15aa9469865 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:11.374396 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ba45e-3b94-4abb-b9e6-a15aa9469865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:11.383594 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ba45e-3b94-4abb-b9e6-a15aa9469865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:11.385035 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ba45e-3b94-4abb-b9e6-a15aa9469865 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:11.395652 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1398/2787] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:11.655626 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c80d82-af45-4ced-9d75-d6b8157bc7c0 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:11.657100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-58c80d82-af45-4ced-9d75-d6b8157bc7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:11.669043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c80d82-af45-4ced-9d75-d6b8157bc7c0 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:11.673651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:11.674491 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:11.674988 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:11.675790 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] PATH_INFO: `/v3/projects/fcf9cc26884a4b0cb96fd77c61e53ebe` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:11.677010 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf9cc26884a4b0cb96fd77c61e53ebe)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:11.678968 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:11.728061 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf9cc26884a4b0cb96fd77c61e53ebe', 'request_id': 'req-bfa667de-cadc-4ece-bb09-948993df8d8b'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.734985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf9cc26884a4b0cb96fd77c61e53ebe', 'request_id': 'req-bfa667de-cadc-4ece-bb09-948993df8d8b'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.742165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf9cc26884a4b0cb96fd77c61e53ebe', 'request_id': 'req-bfa667de-cadc-4ece-bb09-948993df8d8b'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.752021 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] The token cache is being invalidate because project fcf9cc26884a4b0cb96fd77c61e53ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:59:11.752337 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.752972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.754551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1390/2788] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:59:11 2022] DELETE /identity/v3/projects/fcf9cc26884a4b0cb96fd77c61e53ebe => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:11.758631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ba45e-3b94-4abb-b9e6-a15aa9469865 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:11.767899 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ba45e-3b94-4abb-b9e6-a15aa9469865 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:11.823067 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:11.823923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:11.824203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:11.824479 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] PATH_INFO: `/v3/users/353b928980d9465daa516d66bb189cb6` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:11.825674 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=353b928980d9465daa516d66bb189cb6)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:11.827633 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:11.875596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353b928980d9465daa516d66bb189cb6'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.887637 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353b928980d9465daa516d66bb189cb6'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.888341 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353b928980d9465daa516d66bb189cb6'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.888948 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353b928980d9465daa516d66bb189cb6'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.897372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353b928980d9465daa516d66bb189cb6'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:11.909240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1399/2789] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:59:11 2022] DELETE /identity/v3/users/353b928980d9465daa516d66bb189cb6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:12.177090 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:12.178551 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:12.191420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa667de-cadc-4ece-bb09-948993df8d8b admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:12.246949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:12.247803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:12.248085 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:12.248363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] PATH_INFO: `/v3/projects/86d139acebb947cf86e58bc0564f142f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:12.249556 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d139acebb947cf86e58bc0564f142f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:12.251563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:12.296565 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d139acebb947cf86e58bc0564f142f', 'request_id': 'req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.303643 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d139acebb947cf86e58bc0564f142f', 'request_id': 'req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.309954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d139acebb947cf86e58bc0564f142f', 'request_id': 'req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.320046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] The token cache is being invalidate because project 86d139acebb947cf86e58bc0564f142f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:59:12.320331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.320952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.322454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1391/2790] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:59:12 2022] DELETE /identity/v3/projects/86d139acebb947cf86e58bc0564f142f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:12.326434 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:12.327901 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:12.341150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0461f-ded0-4c19-a796-f74985599d0b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:12.398791 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e1d31-dc7f-4932-9221-dd6cc5533695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:12.399679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e1d31-dc7f-4932-9221-dd6cc5533695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:12.399964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e1d31-dc7f-4932-9221-dd6cc5533695 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:12.400240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e1d31-dc7f-4932-9221-dd6cc5533695 admin admin] PATH_INFO: `/v3/users/cffbde4669064512870c3a6830b4787f` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:12.401485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e1d31-dc7f-4932-9221-dd6cc5533695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cffbde4669064512870c3a6830b4787f)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:12.403423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e1d31-dc7f-4932-9221-dd6cc5533695 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:12.449787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9f8e1d31-dc7f-4932-9221-dd6cc5533695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cffbde4669064512870c3a6830b4787f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.461170 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9f8e1d31-dc7f-4932-9221-dd6cc5533695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cffbde4669064512870c3a6830b4787f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.461846 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9f8e1d31-dc7f-4932-9221-dd6cc5533695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cffbde4669064512870c3a6830b4787f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.462450 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9f8e1d31-dc7f-4932-9221-dd6cc5533695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cffbde4669064512870c3a6830b4787f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.469765 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-9f8e1d31-dc7f-4932-9221-dd6cc5533695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cffbde4669064512870c3a6830b4787f'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.483281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1400/2791] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:59:12 2022] DELETE /identity/v3/users/cffbde4669064512870c3a6830b4787f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:12.741116 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:12.742593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:12.755271 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3ab1d-6a9e-464c-9f63-957cc3160c92 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:12.815222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:12.816238 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:12.816530 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:12.816803 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] PATH_INFO: `/v3/projects/9a84ed048c9848f5ab2d8878cec1cb9d` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:12.818004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a84ed048c9848f5ab2d8878cec1cb9d)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:12.819932 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:12.865407 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a84ed048c9848f5ab2d8878cec1cb9d', 'request_id': 'req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.873081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a84ed048c9848f5ab2d8878cec1cb9d', 'request_id': 'req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.879368 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a84ed048c9848f5ab2d8878cec1cb9d', 'request_id': 'req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.889665 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] The token cache is being invalidate because project 9a84ed048c9848f5ab2d8878cec1cb9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:59:12.889952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.890587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-ca2f6605-0668-4d9b-bcc9-f9ff399675e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:12.892133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1392/2792] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:59:12 2022] DELETE /identity/v3/projects/9a84ed048c9848f5ab2d8878cec1cb9d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:12.899461 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff179544-4037-438e-a541-c41fec83d931 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:12.899749 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff179544-4037-438e-a541-c41fec83d931 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:12.900054 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff179544-4037-438e-a541-c41fec83d931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:12.919374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-ff179544-4037-438e-a541-c41fec83d931 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:12.920581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-ff179544-4037-438e-a541-c41fec83d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:12.981708 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1401/2793] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:12.991095 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbccade-6d22-4e86-b4e5-4a0bbb1f9693 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:12.991317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbccade-6d22-4e86-b4e5-4a0bbb1f9693 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:12.991625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbccade-6d22-4e86-b4e5-4a0bbb1f9693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.010363 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-bdbccade-6d22-4e86-b4e5-4a0bbb1f9693 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:13.011589 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-bdbccade-6d22-4e86-b4e5-4a0bbb1f9693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:13.020651 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1393/2794] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:59:13.025042 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff179544-4037-438e-a541-c41fec83d931 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.035333 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff179544-4037-438e-a541-c41fec83d931 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.040184 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd031a68-a42c-43f1-aefe-fda101335b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.040862 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031a68-a42c-43f1-aefe-fda101335b0b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.041147 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031a68-a42c-43f1-aefe-fda101335b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.041423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031a68-a42c-43f1-aefe-fda101335b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.042185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd031a68-a42c-43f1-aefe-fda101335b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:59:13.042491 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd031a68-a42c-43f1-aefe-fda101335b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.044372 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd031a68-a42c-43f1-aefe-fda101335b0b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.056460 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1402/2795] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:59:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:59:13.060684 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbccade-6d22-4e86-b4e5-4a0bbb1f9693 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.070462 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbccade-6d22-4e86-b4e5-4a0bbb1f9693 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.075323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8657e8-2846-43d9-a22d-b7c459b070d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.075969 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8657e8-2846-43d9-a22d-b7c459b070d4 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.076250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8657e8-2846-43d9-a22d-b7c459b070d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.076523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8657e8-2846-43d9-a22d-b7c459b070d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.077232 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8657e8-2846-43d9-a22d-b7c459b070d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.079163 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8657e8-2846-43d9-a22d-b7c459b070d4 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.105190 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1394/2796] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:59:13 2022] POST /identity/v3/projects => generated 376 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:59:13.109699 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd031a68-a42c-43f1-aefe-fda101335b0b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.120727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd031a68-a42c-43f1-aefe-fda101335b0b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.180764 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb354b-e563-4293-82be-70879a7f65a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.181428 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb354b-e563-4293-82be-70879a7f65a0 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.181882 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb354b-e563-4293-82be-70879a7f65a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.182161 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb354b-e563-4293-82be-70879a7f65a0 admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.182897 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb354b-e563-4293-82be-70879a7f65a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.185277 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb354b-e563-4293-82be-70879a7f65a0 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.205034 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1403/2797] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:59:13 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:13.211297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8657e8-2846-43d9-a22d-b7c459b070d4 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.224196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8657e8-2846-43d9-a22d-b7c459b070d4 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.229288 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258b3ab-195c-4d6a-99b7-d465a24ec669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.230291 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258b3ab-195c-4d6a-99b7-d465a24ec669 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.230572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258b3ab-195c-4d6a-99b7-d465a24ec669 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.230879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258b3ab-195c-4d6a-99b7-d465a24ec669 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.231633 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258b3ab-195c-4d6a-99b7-d465a24ec669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.233241 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258b3ab-195c-4d6a-99b7-d465a24ec669 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.245522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1395/2798] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:13 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:59:13.249454 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb354b-e563-4293-82be-70879a7f65a0 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.263787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb354b-e563-4293-82be-70879a7f65a0 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.268797 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e64b3-162d-4cf4-b1ac-bfe87ac94901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.269602 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e64b3-162d-4cf4-b1ac-bfe87ac94901 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.269879 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e64b3-162d-4cf4-b1ac-bfe87ac94901 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.270153 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e64b3-162d-4cf4-b1ac-bfe87ac94901 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.270918 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e64b3-162d-4cf4-b1ac-bfe87ac94901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.272536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e64b3-162d-4cf4-b1ac-bfe87ac94901 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.282854 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1404/2799] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:13 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:13.288087 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258b3ab-195c-4d6a-99b7-d465a24ec669 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.298165 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258b3ab-195c-4d6a-99b7-d465a24ec669 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.304905 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ff3ef-a33e-447d-8904-6ade9c6511b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.305779 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ff3ef-a33e-447d-8904-6ade9c6511b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.306060 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ff3ef-a33e-447d-8904-6ade9c6511b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.306364 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ff3ef-a33e-447d-8904-6ade9c6511b8 admin admin] PATH_INFO: `/v3/projects/4cc1dfdf2a034d4e858b0e0cd973d955/users/01acf98b554b4a76bc60428b93020dad/roles/42656495a54b4164862c9a31838a731e` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.322435 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ff3ef-a33e-447d-8904-6ade9c6511b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc1dfdf2a034d4e858b0e0cd973d955, user_id=01acf98b554b4a76bc60428b93020dad, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.325112 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ff3ef-a33e-447d-8904-6ade9c6511b8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.340136 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1396/2800] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:13 2022] PUT /identity/v3/projects/4cc1dfdf2a034d4e858b0e0cd973d955/users/01acf98b554b4a76bc60428b93020dad/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:13.353139 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faf595-1d93-48e3-8b45-4aab243288de None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.353691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faf595-1d93-48e3-8b45-4aab243288de None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.353691 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faf595-1d93-48e3-8b45-4aab243288de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.385817 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-44faf595-1d93-48e3-8b45-4aab243288de None None] MFA Rules not processed for user `01acf98b554b4a76bc60428b93020dad`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:13.387071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-44faf595-1d93-48e3-8b45-4aab243288de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:13.454834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1405/2801] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:13.460123 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ff3ef-a33e-447d-8904-6ade9c6511b8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.530891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ff3ef-a33e-447d-8904-6ade9c6511b8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.537092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcf667-b0fd-4f71-a417-4f93848697f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.537740 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcf667-b0fd-4f71-a417-4f93848697f0 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.538050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcf667-b0fd-4f71-a417-4f93848697f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.538323 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcf667-b0fd-4f71-a417-4f93848697f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.539053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcf667-b0fd-4f71-a417-4f93848697f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.540979 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcf667-b0fd-4f71-a417-4f93848697f0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.568160 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1397/2802] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:59:13 2022] POST /identity/v3/projects => generated 374 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:13.578310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faf595-1d93-48e3-8b45-4aab243288de None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.593300 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faf595-1d93-48e3-8b45-4aab243288de None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.651310 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab602e1-0e87-42c6-af2e-4f66e1558c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.651990 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab602e1-0e87-42c6-af2e-4f66e1558c0a admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.652273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab602e1-0e87-42c6-af2e-4f66e1558c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.652542 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab602e1-0e87-42c6-af2e-4f66e1558c0a admin admin] PATH_INFO: `/v3/users` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.653486 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab602e1-0e87-42c6-af2e-4f66e1558c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.656249 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab602e1-0e87-42c6-af2e-4f66e1558c0a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.679247 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1406/2803] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:59:13 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:59:13.683229 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcf667-b0fd-4f71-a417-4f93848697f0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.694896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcf667-b0fd-4f71-a417-4f93848697f0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.699694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fea476-ef46-4ee2-9787-f9097db7a0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.700358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fea476-ef46-4ee2-9787-f9097db7a0dd admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.700640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fea476-ef46-4ee2-9787-f9097db7a0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.700924 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fea476-ef46-4ee2-9787-f9097db7a0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.701704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fea476-ef46-4ee2-9787-f9097db7a0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.704454 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fea476-ef46-4ee2-9787-f9097db7a0dd admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.717867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1398/2804] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:13 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:13.722358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab602e1-0e87-42c6-af2e-4f66e1558c0a admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.734840 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab602e1-0e87-42c6-af2e-4f66e1558c0a admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.741804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7a2ba-d1f1-40ea-be68-482b82ae5634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.742715 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a2ba-d1f1-40ea-be68-482b82ae5634 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.743026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a2ba-d1f1-40ea-be68-482b82ae5634 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.743299 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a2ba-d1f1-40ea-be68-482b82ae5634 admin admin] PATH_INFO: `/v3/projects/4942d6b31e054f3ba9e6057b416c25d9/users/365f9e0d145d4732a7e1c0c75008d6c3/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.764640 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7a2ba-d1f1-40ea-be68-482b82ae5634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4942d6b31e054f3ba9e6057b416c25d9, user_id=365f9e0d145d4732a7e1c0c75008d6c3, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.767315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7a2ba-d1f1-40ea-be68-482b82ae5634 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.782615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1407/2805] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:13 2022] PUT /identity/v3/projects/4942d6b31e054f3ba9e6057b416c25d9/users/365f9e0d145d4732a7e1c0c75008d6c3/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:13.787761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fea476-ef46-4ee2-9787-f9097db7a0dd admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.798603 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fea476-ef46-4ee2-9787-f9097db7a0dd admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.860827 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fd27d-a678-45fa-b4e7-f7ee2ae99eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.861500 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fd27d-a678-45fa-b4e7-f7ee2ae99eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.861801 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fd27d-a678-45fa-b4e7-f7ee2ae99eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.862245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fd27d-a678-45fa-b4e7-f7ee2ae99eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.864942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fd27d-a678-45fa-b4e7-f7ee2ae99eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.866557 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fd27d-a678-45fa-b4e7-f7ee2ae99eb8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.876953 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1399/2806] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:13 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:13.882072 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7a2ba-d1f1-40ea-be68-482b82ae5634 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:13.894190 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7a2ba-d1f1-40ea-be68-482b82ae5634 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:13.898903 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0c625-7fc7-4894-896d-600f28018149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:13.899782 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0c625-7fc7-4894-896d-600f28018149 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.900062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0c625-7fc7-4894-896d-600f28018149 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.900343 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0c625-7fc7-4894-896d-600f28018149 admin admin] PATH_INFO: `/v3/projects/4942d6b31e054f3ba9e6057b416c25d9/users/365f9e0d145d4732a7e1c0c75008d6c3/roles/92a6afea4f7e4005a5802785c009f5d3` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.902314 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0c625-7fc7-4894-896d-600f28018149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4942d6b31e054f3ba9e6057b416c25d9, user_id=365f9e0d145d4732a7e1c0c75008d6c3, role_id=92a6afea4f7e4005a5802785c009f5d3)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:13.904958 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0c625-7fc7-4894-896d-600f28018149 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:13.918470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1408/2807] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:13 2022] PUT /identity/v3/projects/4942d6b31e054f3ba9e6057b416c25d9/users/365f9e0d145d4732a7e1c0c75008d6c3/roles/92a6afea4f7e4005a5802785c009f5d3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:13.929809 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dfd5f-1115-4c36-9ff8-f0f25dbb7356 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:13.930126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dfd5f-1115-4c36-9ff8-f0f25dbb7356 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:13.930420 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dfd5f-1115-4c36-9ff8-f0f25dbb7356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:13.957922 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-5c8dfd5f-1115-4c36-9ff8-f0f25dbb7356 None None] MFA Rules not processed for user `365f9e0d145d4732a7e1c0c75008d6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:13.959176 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5c8dfd5f-1115-4c36-9ff8-f0f25dbb7356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:14.024509 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1400/2808] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:59:14.034241 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0c625-7fc7-4894-896d-600f28018149 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:14.036493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b7b0c625-7fc7-4894-896d-600f28018149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:14.093470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0c625-7fc7-4894-896d-600f28018149 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:14.097643 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59df9d-db4d-4f37-8864-1561f21454c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:14.098255 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59df9d-db4d-4f37-8864-1561f21454c1 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:14.098539 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59df9d-db4d-4f37-8864-1561f21454c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:14.098841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59df9d-db4d-4f37-8864-1561f21454c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:14.155374 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59df9d-db4d-4f37-8864-1561f21454c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:14.156808 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59df9d-db4d-4f37-8864-1561f21454c1 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:14.166347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1409/2809] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:16.669636 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dfd5f-1115-4c36-9ff8-f0f25dbb7356 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:16.728526 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dfd5f-1115-4c36-9ff8-f0f25dbb7356 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:16.733062 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:16.733911 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:16.734189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:16.734458 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] PATH_INFO: `/v3/users/01acf98b554b4a76bc60428b93020dad` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:16.735679 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01acf98b554b4a76bc60428b93020dad)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:16.738076 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:16.785213 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01acf98b554b4a76bc60428b93020dad'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:16.792548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01acf98b554b4a76bc60428b93020dad'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:16.799617 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01acf98b554b4a76bc60428b93020dad'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:16.812996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01acf98b554b4a76bc60428b93020dad'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:16.817980 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01acf98b554b4a76bc60428b93020dad'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:16.824967 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1401/2810] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:59:16 2022] DELETE /identity/v3/users/01acf98b554b4a76bc60428b93020dad => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:16.829772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321931e5-0eeb-46b5-b3cf-d26dd5985782 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:16.830224 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321931e5-0eeb-46b5-b3cf-d26dd5985782 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:16.830597 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321931e5-0eeb-46b5-b3cf-d26dd5985782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:16.847636 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-321931e5-0eeb-46b5-b3cf-d26dd5985782 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:16.848838 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-321931e5-0eeb-46b5-b3cf-d26dd5985782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:16.907769 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1410/2811] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:16.917560 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:16.919333 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:16.983197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea6aea-5ca8-487a-a36c-42acb6cd5ff0 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:16.987150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdb144-69f6-487e-bb23-6fcd26fff6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:16.988569 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdb144-69f6-487e-bb23-6fcd26fff6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:16.988849 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdb144-69f6-487e-bb23-6fcd26fff6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:16.989145 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdb144-69f6-487e-bb23-6fcd26fff6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:16.999313 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdb144-69f6-487e-bb23-6fcd26fff6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:17.001064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdb144-69f6-487e-bb23-6fcd26fff6b8 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:17.011523 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1402/2812] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:17.287694 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321931e5-0eeb-46b5-b3cf-d26dd5985782 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:17.289218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-321931e5-0eeb-46b5-b3cf-d26dd5985782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:17.302946 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321931e5-0eeb-46b5-b3cf-d26dd5985782 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:17.307706 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:17.308558 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:17.308841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:17.309115 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] PATH_INFO: `/v3/projects/4cc1dfdf2a034d4e858b0e0cd973d955` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:17.310317 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc1dfdf2a034d4e858b0e0cd973d955)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:17.312231 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:17.360760 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc1dfdf2a034d4e858b0e0cd973d955', 'request_id': 'req-de80be49-2702-4a4e-aa34-75ee74c68b76'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.366968 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc1dfdf2a034d4e858b0e0cd973d955', 'request_id': 'req-de80be49-2702-4a4e-aa34-75ee74c68b76'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.373620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc1dfdf2a034d4e858b0e0cd973d955', 'request_id': 'req-de80be49-2702-4a4e-aa34-75ee74c68b76'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.384618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] The token cache is being invalidate because project 4cc1dfdf2a034d4e858b0e0cd973d955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:59:17.384900 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.385515 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.387055 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1411/2813] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:59:17 2022] DELETE /identity/v3/projects/4cc1dfdf2a034d4e858b0e0cd973d955 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:17.390985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdb144-69f6-487e-bb23-6fcd26fff6b8 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:17.401001 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdb144-69f6-487e-bb23-6fcd26fff6b8 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:17.455091 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5649a1a-cbef-4cab-a25f-7e7d026bb62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:17.455896 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649a1a-cbef-4cab-a25f-7e7d026bb62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:17.456777 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649a1a-cbef-4cab-a25f-7e7d026bb62e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:17.457167 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649a1a-cbef-4cab-a25f-7e7d026bb62e admin admin] PATH_INFO: `/v3/users/365f9e0d145d4732a7e1c0c75008d6c3` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:17.458412 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5649a1a-cbef-4cab-a25f-7e7d026bb62e admin admin] RBAC: Authorizing `identity:delete_user(user_id=365f9e0d145d4732a7e1c0c75008d6c3)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:17.460362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5649a1a-cbef-4cab-a25f-7e7d026bb62e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:17.508620 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d5649a1a-cbef-4cab-a25f-7e7d026bb62e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365f9e0d145d4732a7e1c0c75008d6c3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.515877 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d5649a1a-cbef-4cab-a25f-7e7d026bb62e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365f9e0d145d4732a7e1c0c75008d6c3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.524066 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d5649a1a-cbef-4cab-a25f-7e7d026bb62e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365f9e0d145d4732a7e1c0c75008d6c3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.536509 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d5649a1a-cbef-4cab-a25f-7e7d026bb62e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365f9e0d145d4732a7e1c0c75008d6c3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.537227 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-d5649a1a-cbef-4cab-a25f-7e7d026bb62e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365f9e0d145d4732a7e1c0c75008d6c3'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.543353 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1403/2814] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:59:17 2022] DELETE /identity/v3/users/365f9e0d145d4732a7e1c0c75008d6c3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:17.800365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:17.802061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:17.818550 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80be49-2702-4a4e-aa34-75ee74c68b76 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:17.876215 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:17.877065 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:17.877346 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:17.877618 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] PATH_INFO: `/v3/projects/4942d6b31e054f3ba9e6057b416c25d9` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:17.879766 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4942d6b31e054f3ba9e6057b416c25d9)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:17.881936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:17.926886 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4942d6b31e054f3ba9e6057b416c25d9', 'request_id': 'req-09c9c16c-46e9-415e-bc68-b3a3165b543a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.932114 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4942d6b31e054f3ba9e6057b416c25d9', 'request_id': 'req-09c9c16c-46e9-415e-bc68-b3a3165b543a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.939316 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4942d6b31e054f3ba9e6057b416c25d9', 'request_id': 'req-09c9c16c-46e9-415e-bc68-b3a3165b543a'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.950898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] The token cache is being invalidate because project 4942d6b31e054f3ba9e6057b416c25d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:59:17.951185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.951807 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-09c9c16c-46e9-415e-bc68-b3a3165b543a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:17.953321 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1412/2815] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:59:17 2022] DELETE /identity/v3/projects/4942d6b31e054f3ba9e6057b416c25d9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:17.959668 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc3212-09e8-4f9e-b80b-c8dbb58731e9 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:17.960155 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc3212-09e8-4f9e-b80b-c8dbb58731e9 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:17.960264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc3212-09e8-4f9e-b80b-c8dbb58731e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:17.977898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-19cc3212-09e8-4f9e-b80b-c8dbb58731e9 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:17.979122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-19cc3212-09e8-4f9e-b80b-c8dbb58731e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:18.035498 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1404/2816] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:18.043671 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a36940-fa7c-423d-be82-16acbdea3d4b None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:18.043958 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a36940-fa7c-423d-be82-16acbdea3d4b None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:18.044234 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a36940-fa7c-423d-be82-16acbdea3d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:18.062612 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-22a36940-fa7c-423d-be82-16acbdea3d4b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:18.063847 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-22a36940-fa7c-423d-be82-16acbdea3d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:18.072587 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1413/2817] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:18.076696 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc3212-09e8-4f9e-b80b-c8dbb58731e9 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:18.086947 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc3212-09e8-4f9e-b80b-c8dbb58731e9 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:18.091660 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69d171-171c-46c6-b9c7-8a5609c71775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:18.092304 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69d171-171c-46c6-b9c7-8a5609c71775 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:18.093041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69d171-171c-46c6-b9c7-8a5609c71775 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:18.093041 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69d171-171c-46c6-b9c7-8a5609c71775 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:18.093541 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69d171-171c-46c6-b9c7-8a5609c71775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:59:18.093844 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69d171-171c-46c6-b9c7-8a5609c71775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:18.095450 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69d171-171c-46c6-b9c7-8a5609c71775 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:18.107029 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1405/2818] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:59:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:59:18.111382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a36940-fa7c-423d-be82-16acbdea3d4b None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:18.121582 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a36940-fa7c-423d-be82-16acbdea3d4b None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:18.143338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82721c9e-9793-430f-b1cf-120773c20658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:18.144942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82721c9e-9793-430f-b1cf-120773c20658 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:18.145383 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82721c9e-9793-430f-b1cf-120773c20658 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:18.145872 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82721c9e-9793-430f-b1cf-120773c20658 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:18.146606 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82721c9e-9793-430f-b1cf-120773c20658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:18.148598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82721c9e-9793-430f-b1cf-120773c20658 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:18.180892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1414/2819] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:59:18 2022] POST /identity/v3/projects => generated 376 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:18.185149 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69d171-171c-46c6-b9c7-8a5609c71775 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:18.195547 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69d171-171c-46c6-b9c7-8a5609c71775 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:18.265135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9c2c1-6a0d-47bc-8b8a-fa8e89a10fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:18.265713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9c2c1-6a0d-47bc-8b8a-fa8e89a10fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:18.266199 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9c2c1-6a0d-47bc-8b8a-fa8e89a10fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:18.266532 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9c2c1-6a0d-47bc-8b8a-fa8e89a10fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:18.267365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9c2c1-6a0d-47bc-8b8a-fa8e89a10fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:18.270192 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9c2c1-6a0d-47bc-8b8a-fa8e89a10fb8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:18.292455 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1406/2820] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:59:18 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:18.296942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82721c9e-9793-430f-b1cf-120773c20658 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:18.313082 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82721c9e-9793-430f-b1cf-120773c20658 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:18.314435 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c4e3-1cf5-4a6e-bcb9-da6e4fd08074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:18.315189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c4e3-1cf5-4a6e-bcb9-da6e4fd08074 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:18.316119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c4e3-1cf5-4a6e-bcb9-da6e4fd08074 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:18.316399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c4e3-1cf5-4a6e-bcb9-da6e4fd08074 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:18.317193 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580c4e3-1cf5-4a6e-bcb9-da6e4fd08074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:18.318773 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580c4e3-1cf5-4a6e-bcb9-da6e4fd08074 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:18.331099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1415/2821] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:18 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:18.335035 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9c2c1-6a0d-47bc-8b8a-fa8e89a10fb8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:18.344942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9c2c1-6a0d-47bc-8b8a-fa8e89a10fb8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:18.349694 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a204e0c-bd4b-4de8-909a-570d2e02466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:18.350338 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a204e0c-bd4b-4de8-909a-570d2e02466a admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:18.350622 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a204e0c-bd4b-4de8-909a-570d2e02466a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:18.350942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a204e0c-bd4b-4de8-909a-570d2e02466a admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:18.351685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a204e0c-bd4b-4de8-909a-570d2e02466a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:18.353264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a204e0c-bd4b-4de8-909a-570d2e02466a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:18.363494 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1407/2822] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:18 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:18.367561 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c4e3-1cf5-4a6e-bcb9-da6e4fd08074 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:18.377071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c4e3-1cf5-4a6e-bcb9-da6e4fd08074 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:18.382366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f6b76-a36c-4c85-9638-9ff816a09818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:18.383245 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f6b76-a36c-4c85-9638-9ff816a09818 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:18.383519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f6b76-a36c-4c85-9638-9ff816a09818 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:18.383788 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f6b76-a36c-4c85-9638-9ff816a09818 admin admin] PATH_INFO: `/v3/projects/ba2b80c5caea487ea1ef88472b5c6fa5/users/d0e0a714616748dfa71f468ba1751a67/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:18.398208 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f6b76-a36c-4c85-9638-9ff816a09818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2b80c5caea487ea1ef88472b5c6fa5, user_id=d0e0a714616748dfa71f468ba1751a67, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:18.400933 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f6b76-a36c-4c85-9638-9ff816a09818 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:18.413416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1416/2823] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:18 2022] PUT /identity/v3/projects/ba2b80c5caea487ea1ef88472b5c6fa5/users/d0e0a714616748dfa71f468ba1751a67/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:59:18.424567 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f49bc-87b6-4e1a-9be3-2710558d3fc0 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:18.424881 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f49bc-87b6-4e1a-9be3-2710558d3fc0 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:18.425495 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f49bc-87b6-4e1a-9be3-2710558d3fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:18.451383 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-662f49bc-87b6-4e1a-9be3-2710558d3fc0 None None] MFA Rules not processed for user `d0e0a714616748dfa71f468ba1751a67`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:18.452572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-662f49bc-87b6-4e1a-9be3-2710558d3fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:18.515658 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1408/2824] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:18.526860 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f6b76-a36c-4c85-9638-9ff816a09818 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:18.528575 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-110f6b76-a36c-4c85-9638-9ff816a09818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:18.586523 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f6b76-a36c-4c85-9638-9ff816a09818 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:18.590173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523f397-d94e-40d1-b956-a353be2094a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:18.590848 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523f397-d94e-40d1-b956-a353be2094a1 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:18.591133 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523f397-d94e-40d1-b956-a353be2094a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:18.591410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523f397-d94e-40d1-b956-a353be2094a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:18.599688 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523f397-d94e-40d1-b956-a353be2094a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:18.601099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523f397-d94e-40d1-b956-a353be2094a1 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:18.609569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1417/2825] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:23.629264 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f49bc-87b6-4e1a-9be3-2710558d3fc0 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:23.693050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f49bc-87b6-4e1a-9be3-2710558d3fc0 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:23.697987 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:23.699322 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:23.699728 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:23.700030 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] PATH_INFO: `/v3/users/d0e0a714616748dfa71f468ba1751a67` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:23.701533 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e0a714616748dfa71f468ba1751a67)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:23.703794 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:23.750686 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e0a714616748dfa71f468ba1751a67'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:23.758681 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e0a714616748dfa71f468ba1751a67'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:23.765451 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e0a714616748dfa71f468ba1751a67'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:23.777759 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e0a714616748dfa71f468ba1751a67'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:23.778408 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e0a714616748dfa71f468ba1751a67'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:23.784403 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1409/2826] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:59:23 2022] DELETE /identity/v3/users/d0e0a714616748dfa71f468ba1751a67 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:23.788975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7661aeb-375f-4c18-80f9-5294fa68f817 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:23.789470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7661aeb-375f-4c18-80f9-5294fa68f817 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:23.789576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7661aeb-375f-4c18-80f9-5294fa68f817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:23.806196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-f7661aeb-375f-4c18-80f9-5294fa68f817 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:23.807421 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f7661aeb-375f-4c18-80f9-5294fa68f817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:23.875502 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1418/2827] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:59:23.885837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:23.887307 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:23.942813 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6395d-219d-43d1-8011-1dbe9a845f48 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:23.946672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839c6ed-2d9c-42d0-abb2-94b134b429f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:23.947343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c6ed-2d9c-42d0-abb2-94b134b429f3 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:23.947625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c6ed-2d9c-42d0-abb2-94b134b429f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:23.947902 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c6ed-2d9c-42d0-abb2-94b134b429f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:23.957385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839c6ed-2d9c-42d0-abb2-94b134b429f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:23.958826 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839c6ed-2d9c-42d0-abb2-94b134b429f3 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:23.968000 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1410/2828] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:24.233362 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7661aeb-375f-4c18-80f9-5294fa68f817 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:24.234493 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-f7661aeb-375f-4c18-80f9-5294fa68f817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:24.247688 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7661aeb-375f-4c18-80f9-5294fa68f817 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:24.251619 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:24.252630 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:24.253531 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:24.253816 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] PATH_INFO: `/v3/projects/ba2b80c5caea487ea1ef88472b5c6fa5` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:24.255158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba2b80c5caea487ea1ef88472b5c6fa5)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:24.257050 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:24.306403 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2b80c5caea487ea1ef88472b5c6fa5', 'request_id': 'req-009e3794-f811-4c5f-a05b-d9ee17303713'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:24.312033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2b80c5caea487ea1ef88472b5c6fa5', 'request_id': 'req-009e3794-f811-4c5f-a05b-d9ee17303713'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:24.320161 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2b80c5caea487ea1ef88472b5c6fa5', 'request_id': 'req-009e3794-f811-4c5f-a05b-d9ee17303713'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:24.332062 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] The token cache is being invalidate because project ba2b80c5caea487ea1ef88472b5c6fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:59:24.332340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:24.332960 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-009e3794-f811-4c5f-a05b-d9ee17303713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:24.334473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1419/2829] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:59:24 2022] DELETE /identity/v3/projects/ba2b80c5caea487ea1ef88472b5c6fa5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:24.341587 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183e09f-8305-4e64-8867-29314f50fc5b None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:24.341879 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183e09f-8305-4e64-8867-29314f50fc5b None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:24.342159 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183e09f-8305-4e64-8867-29314f50fc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:24.360935 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-7183e09f-8305-4e64-8867-29314f50fc5b None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:24.362970 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-7183e09f-8305-4e64-8867-29314f50fc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:24.423127 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1411/2830] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:24.431800 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302a08-b154-4aa7-826a-934372c122f4 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:24.432087 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302a08-b154-4aa7-826a-934372c122f4 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:24.432366 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302a08-b154-4aa7-826a-934372c122f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:24.451289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-05302a08-b154-4aa7-826a-934372c122f4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:24.452467 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-05302a08-b154-4aa7-826a-934372c122f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:24.460463 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1420/2831] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:24.464625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183e09f-8305-4e64-8867-29314f50fc5b None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:24.474727 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183e09f-8305-4e64-8867-29314f50fc5b None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:24.479276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4161c-b9ab-49a2-8781-83f1adb4d8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:24.479918 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4161c-b9ab-49a2-8781-83f1adb4d8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:24.480197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4161c-b9ab-49a2-8781-83f1adb4d8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:24.480470 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4161c-b9ab-49a2-8781-83f1adb4d8c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:24.481203 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4161c-b9ab-49a2-8781-83f1adb4d8c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:59:24.481509 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4161c-b9ab-49a2-8781-83f1adb4d8c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:24.483239 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4161c-b9ab-49a2-8781-83f1adb4d8c6 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:24.496265 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1412/2832] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:59:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:59:24.500470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05302a08-b154-4aa7-826a-934372c122f4 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:24.509536 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05302a08-b154-4aa7-826a-934372c122f4 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:24.514584 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccacdd-cd94-48d1-be51-055e2579a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:24.515273 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccacdd-cd94-48d1-be51-055e2579a299 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:24.515557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccacdd-cd94-48d1-be51-055e2579a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:24.515834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccacdd-cd94-48d1-be51-055e2579a299 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:24.516532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccacdd-cd94-48d1-be51-055e2579a299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:24.518713 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccacdd-cd94-48d1-be51-055e2579a299 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:24.543927 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1421/2833] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:59:24 2022] POST /identity/v3/projects => generated 368 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:24.547991 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4161c-b9ab-49a2-8781-83f1adb4d8c6 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:24.558442 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4161c-b9ab-49a2-8781-83f1adb4d8c6 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:24.611297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68203660-a184-4bd4-9cf4-c40235c64ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:24.612653 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203660-a184-4bd4-9cf4-c40235c64ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:24.612929 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203660-a184-4bd4-9cf4-c40235c64ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:24.613069 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203660-a184-4bd4-9cf4-c40235c64ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:24.613755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68203660-a184-4bd4-9cf4-c40235c64ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:24.615692 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68203660-a184-4bd4-9cf4-c40235c64ba8 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:24.636166 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1413/2834] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:59:24 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:24.640216 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccacdd-cd94-48d1-be51-055e2579a299 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:24.650490 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccacdd-cd94-48d1-be51-055e2579a299 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:24.655150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b30b-8273-485e-8109-722296cd0d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:24.655785 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b30b-8273-485e-8109-722296cd0d28 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:24.656061 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b30b-8273-485e-8109-722296cd0d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:24.656328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b30b-8273-485e-8109-722296cd0d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:24.657043 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7b30b-8273-485e-8109-722296cd0d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:24.658592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7b30b-8273-485e-8109-722296cd0d28 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:24.669679 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1422/2835] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:24 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:59:24.673498 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68203660-a184-4bd4-9cf4-c40235c64ba8 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:24.684139 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68203660-a184-4bd4-9cf4-c40235c64ba8 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:24.688667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a8908-f042-43f7-a4d8-2ee8e5d16912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:24.689346 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a8908-f042-43f7-a4d8-2ee8e5d16912 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:24.689625 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a8908-f042-43f7-a4d8-2ee8e5d16912 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:24.689950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a8908-f042-43f7-a4d8-2ee8e5d16912 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:24.691327 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a8908-f042-43f7-a4d8-2ee8e5d16912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:24.692938 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a8908-f042-43f7-a4d8-2ee8e5d16912 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:24.702474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1414/2836] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:24 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 24 16:59:24.706730 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b30b-8273-485e-8109-722296cd0d28 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:24.716470 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b30b-8273-485e-8109-722296cd0d28 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:24.721721 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d5e1d-2e7d-4c83-b809-bfd79586a918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:24.723071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d5e1d-2e7d-4c83-b809-bfd79586a918 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:24.723357 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d5e1d-2e7d-4c83-b809-bfd79586a918 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:24.723631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d5e1d-2e7d-4c83-b809-bfd79586a918 admin admin] PATH_INFO: `/v3/projects/662eb456424e4753b4815d94882641fb/users/ab7566c4d8b9491d8c274c2044630e60/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:24.738486 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d5e1d-2e7d-4c83-b809-bfd79586a918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662eb456424e4753b4815d94882641fb, user_id=ab7566c4d8b9491d8c274c2044630e60, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:24.741328 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d5e1d-2e7d-4c83-b809-bfd79586a918 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:24.755338 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1423/2837] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:24 2022] PUT /identity/v3/projects/662eb456424e4753b4815d94882641fb/users/ab7566c4d8b9491d8c274c2044630e60/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:24.766469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdaddc-fe5f-480a-8ab8-879434375b46 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:24.766778 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdaddc-fe5f-480a-8ab8-879434375b46 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:24.767070 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdaddc-fe5f-480a-8ab8-879434375b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:24.796414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-6ebdaddc-fe5f-480a-8ab8-879434375b46 None None] MFA Rules not processed for user `ab7566c4d8b9491d8c274c2044630e60`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:24.797712 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-6ebdaddc-fe5f-480a-8ab8-879434375b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:24.864182 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1415/2838] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:24.875660 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d5e1d-2e7d-4c83-b809-bfd79586a918 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:24.877358 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-076d5e1d-2e7d-4c83-b809-bfd79586a918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:24.934489 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d5e1d-2e7d-4c83-b809-bfd79586a918 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:24.938596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef4936-6284-4d77-a034-363221e22369 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2691f7bb4ed84de4bb5901710a96d766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:24.939304 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef4936-6284-4d77-a034-363221e22369 service glance] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:24.939585 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef4936-6284-4d77-a034-363221e22369 service glance] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:24.940078 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef4936-6284-4d77-a034-363221e22369 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:24.948420 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef4936-6284-4d77-a034-363221e22369 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:24.949841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef4936-6284-4d77-a034-363221e22369 service glance] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:24.960541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1424/2839] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 16:59:27.004324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdaddc-fe5f-480a-8ab8-879434375b46 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:27.005876 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-6ebdaddc-fe5f-480a-8ab8-879434375b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:27.070208 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdaddc-fe5f-480a-8ab8-879434375b46 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:27.074881 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:27.075747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:27.076028 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:27.076305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] PATH_INFO: `/v3/users/818b5a37eb3c4883a044649c24f846d6` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:27.077527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=818b5a37eb3c4883a044649c24f846d6)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:27.079601 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:27.127478 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '818b5a37eb3c4883a044649c24f846d6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:27.135314 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '818b5a37eb3c4883a044649c24f846d6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:27.142276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '818b5a37eb3c4883a044649c24f846d6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:27.154781 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '818b5a37eb3c4883a044649c24f846d6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:27.155592 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '818b5a37eb3c4883a044649c24f846d6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:27.161864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1416/2840] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:59:27 2022] DELETE /identity/v3/users/818b5a37eb3c4883a044649c24f846d6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:27.166342 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6c676-e314-4a68-8116-3c1f02d29d61 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:27.166811 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6c676-e314-4a68-8116-3c1f02d29d61 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:27.167058 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6c676-e314-4a68-8116-3c1f02d29d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:27.185667 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-9bf6c676-e314-4a68-8116-3c1f02d29d61 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:27.186908 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9bf6c676-e314-4a68-8116-3c1f02d29d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:27.246281 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1425/2841] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:27.256393 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:27.257786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:27.316341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ccdf6-290b-4267-ba49-1d9716ce25d7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:27.320032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a65595-c867-4da7-86a0-353807364b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:27.320675 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a65595-c867-4da7-86a0-353807364b29 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:27.320956 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a65595-c867-4da7-86a0-353807364b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:27.321233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a65595-c867-4da7-86a0-353807364b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:27.330126 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a65595-c867-4da7-86a0-353807364b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:27.332075 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a65595-c867-4da7-86a0-353807364b29 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:27.341198 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1417/2842] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:27.610834 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6c676-e314-4a68-8116-3c1f02d29d61 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:27.612270 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9bf6c676-e314-4a68-8116-3c1f02d29d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:27.625448 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6c676-e314-4a68-8116-3c1f02d29d61 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:27.630949 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:27.631986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:27.632268 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:27.632543 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] PATH_INFO: `/v3/projects/a2947438820e4664aa20c3c7b4aa57a4` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:27.633772 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2947438820e4664aa20c3c7b4aa57a4)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:27.635735 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:27.683863 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2947438820e4664aa20c3c7b4aa57a4', 'request_id': 'req-e089663f-b3ff-40b4-aaf8-1244303d6902'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:27.689532 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2947438820e4664aa20c3c7b4aa57a4', 'request_id': 'req-e089663f-b3ff-40b4-aaf8-1244303d6902'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:27.698315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2947438820e4664aa20c3c7b4aa57a4', 'request_id': 'req-e089663f-b3ff-40b4-aaf8-1244303d6902'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:27.709726 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] The token cache is being invalidate because project a2947438820e4664aa20c3c7b4aa57a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:59:27.710015 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:27.710646 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e089663f-b3ff-40b4-aaf8-1244303d6902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:27.712229 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1426/2843] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:59:27 2022] DELETE /identity/v3/projects/a2947438820e4664aa20c3c7b4aa57a4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:27.717763 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50f743-7e38-4bd5-b967-b4af0f7c669c None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:27.718050 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50f743-7e38-4bd5-b967-b4af0f7c669c None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:27.718324 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50f743-7e38-4bd5-b967-b4af0f7c669c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:27.736544 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-fa50f743-7e38-4bd5-b967-b4af0f7c669c None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:27.737737 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-fa50f743-7e38-4bd5-b967-b4af0f7c669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:27.797640 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1418/2844] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:27.805416 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b925ee-0e57-46a9-90cf-e55d838fafd4 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:27.805841 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b925ee-0e57-46a9-90cf-e55d838fafd4 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:27.806115 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b925ee-0e57-46a9-90cf-e55d838fafd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:27.825445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-a0b925ee-0e57-46a9-90cf-e55d838fafd4 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:27.826627 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-a0b925ee-0e57-46a9-90cf-e55d838fafd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:27.836340 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1427/2845] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:27.840460 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50f743-7e38-4bd5-b967-b4af0f7c669c None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:27.851051 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50f743-7e38-4bd5-b967-b4af0f7c669c None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:27.855574 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ef190-345c-4a18-8f2c-1a4d5233eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:27.856250 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ef190-345c-4a18-8f2c-1a4d5233eb35 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:27.856566 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ef190-345c-4a18-8f2c-1a4d5233eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:27.856844 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ef190-345c-4a18-8f2c-1a4d5233eb35 admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:27.857576 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ef190-345c-4a18-8f2c-1a4d5233eb35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:59:27.857883 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ef190-345c-4a18-8f2c-1a4d5233eb35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:27.859508 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ef190-345c-4a18-8f2c-1a4d5233eb35 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:27.870618 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1419/2846] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:59:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 24 16:59:27.875173 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b925ee-0e57-46a9-90cf-e55d838fafd4 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:27.885375 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b925ee-0e57-46a9-90cf-e55d838fafd4 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:27.889954 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3594a-cc73-4395-ab84-11b843d42aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:27.890631 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3594a-cc73-4395-ab84-11b843d42aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:27.890942 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3594a-cc73-4395-ab84-11b843d42aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:27.891218 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3594a-cc73-4395-ab84-11b843d42aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:27.891925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3594a-cc73-4395-ab84-11b843d42aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:27.893828 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3594a-cc73-4395-ab84-11b843d42aa8 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:27.925969 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1428/2847] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:59:27 2022] POST /identity/v3/projects => generated 376 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:27.930134 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ef190-345c-4a18-8f2c-1a4d5233eb35 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:27.940302 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ef190-345c-4a18-8f2c-1a4d5233eb35 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:27.997348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19186b7-e17a-4a62-a795-8fa04076358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:27.998025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19186b7-e17a-4a62-a795-8fa04076358e admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:27.998301 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19186b7-e17a-4a62-a795-8fa04076358e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:27.998573 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19186b7-e17a-4a62-a795-8fa04076358e admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:27.999315 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19186b7-e17a-4a62-a795-8fa04076358e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:28.001212 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19186b7-e17a-4a62-a795-8fa04076358e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:28.021067 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1420/2848] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:59:27 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:59:28.025189 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3594a-cc73-4395-ab84-11b843d42aa8 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:28.037737 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3594a-cc73-4395-ab84-11b843d42aa8 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:28.042555 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac9ca1-27ba-4bfa-bb62-9411f1d7c750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:28.043289 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac9ca1-27ba-4bfa-bb62-9411f1d7c750 admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:28.043569 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac9ca1-27ba-4bfa-bb62-9411f1d7c750 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:28.043842 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac9ca1-27ba-4bfa-bb62-9411f1d7c750 admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:28.044566 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac9ca1-27ba-4bfa-bb62-9411f1d7c750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:28.046134 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac9ca1-27ba-4bfa-bb62-9411f1d7c750 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:28.057486 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1429/2849] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:28 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:28.061385 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19186b7-e17a-4a62-a795-8fa04076358e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:28.072710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19186b7-e17a-4a62-a795-8fa04076358e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:28.077343 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9f979-66b4-4dea-93d9-3b03e859b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:28.077997 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9f979-66b4-4dea-93d9-3b03e859b8ab admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:28.078276 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9f979-66b4-4dea-93d9-3b03e859b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:28.078548 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9f979-66b4-4dea-93d9-3b03e859b8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:28.079316 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9f979-66b4-4dea-93d9-3b03e859b8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:28.080891 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9f979-66b4-4dea-93d9-3b03e859b8ab admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:28.091483 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1421/2850] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:28 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:28.095784 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac9ca1-27ba-4bfa-bb62-9411f1d7c750 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:28.106363 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac9ca1-27ba-4bfa-bb62-9411f1d7c750 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:28.111158 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16251a7-ec4b-4541-87f0-a6563d0f4ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:28.112012 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16251a7-ec4b-4541-87f0-a6563d0f4ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:28.112294 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16251a7-ec4b-4541-87f0-a6563d0f4ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:28.112565 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16251a7-ec4b-4541-87f0-a6563d0f4ed2 admin admin] PATH_INFO: `/v3/projects/5bfe8e2002df4a03b8904d7f8281939a/users/47bd4e4c0d4f4f75889651c53579da7f/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:28.127242 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16251a7-ec4b-4541-87f0-a6563d0f4ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfe8e2002df4a03b8904d7f8281939a, user_id=47bd4e4c0d4f4f75889651c53579da7f, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:28.130473 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16251a7-ec4b-4541-87f0-a6563d0f4ed2 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:28.148508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1430/2851] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:28 2022] PUT /identity/v3/projects/5bfe8e2002df4a03b8904d7f8281939a/users/47bd4e4c0d4f4f75889651c53579da7f/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:28.159106 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4b16c-793d-493b-b38f-6dc386557334 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:28.159398 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4b16c-793d-493b-b38f-6dc386557334 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:28.159685 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4b16c-793d-493b-b38f-6dc386557334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:28.187083 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-0ce4b16c-793d-493b-b38f-6dc386557334 None None] MFA Rules not processed for user `47bd4e4c0d4f4f75889651c53579da7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:28.188268 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-0ce4b16c-793d-493b-b38f-6dc386557334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:28.254144 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1422/2852] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:28.264259 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16251a7-ec4b-4541-87f0-a6563d0f4ed2 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:28.265975 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-c16251a7-ec4b-4541-87f0-a6563d0f4ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:28.323601 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16251a7-ec4b-4541-87f0-a6563d0f4ed2 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:28.327187 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9b97c-7f10-42d8-998a-0c21185ff252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:28.327842 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9b97c-7f10-42d8-998a-0c21185ff252 service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:28.328099 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9b97c-7f10-42d8-998a-0c21185ff252 service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:28.328373 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9b97c-7f10-42d8-998a-0c21185ff252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:28.336504 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9b97c-7f10-42d8-998a-0c21185ff252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:28.337964 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9b97c-7f10-42d8-998a-0c21185ff252 service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:28.346727 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1431/2853] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:37.990836 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4b16c-793d-493b-b38f-6dc386557334 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:38.052985 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4b16c-793d-493b-b38f-6dc386557334 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:38.057520 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:38.058423 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:38.058713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:38.059027 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] PATH_INFO: `/v3/users/47bd4e4c0d4f4f75889651c53579da7f` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:38.060248 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bd4e4c0d4f4f75889651c53579da7f)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:38.062189 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:38.107152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bd4e4c0d4f4f75889651c53579da7f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:38.115456 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bd4e4c0d4f4f75889651c53579da7f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:38.122799 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bd4e4c0d4f4f75889651c53579da7f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:38.138300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bd4e4c0d4f4f75889651c53579da7f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:38.139519 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bd4e4c0d4f4f75889651c53579da7f'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:38.148157 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1423/2854] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:59:37 2022] DELETE /identity/v3/users/47bd4e4c0d4f4f75889651c53579da7f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:38.152490 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c52bb-fa01-415f-89e4-b3d8c3b3b957 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:38.152986 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c52bb-fa01-415f-89e4-b3d8c3b3b957 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:38.153097 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c52bb-fa01-415f-89e4-b3d8c3b3b957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:38.171499 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-235c52bb-fa01-415f-89e4-b3d8c3b3b957 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:38.172749 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-235c52bb-fa01-415f-89e4-b3d8c3b3b957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:38.231541 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1432/2855] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:59:38.254552 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:38.256059 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:38.312886 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aee4a6-0a13-4d05-9553-df0be5847921 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:38.316748 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90da4bd-684b-4961-a15a-81d0225b9880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:38.317428 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90da4bd-684b-4961-a15a-81d0225b9880 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:38.317714 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90da4bd-684b-4961-a15a-81d0225b9880 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:38.318024 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90da4bd-684b-4961-a15a-81d0225b9880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:38.327300 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90da4bd-684b-4961-a15a-81d0225b9880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:38.328719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90da4bd-684b-4961-a15a-81d0225b9880 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:38.339049 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1424/2856] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:38.690201 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c52bb-fa01-415f-89e4-b3d8c3b3b957 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:38.692260 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-235c52bb-fa01-415f-89e4-b3d8c3b3b957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:38.704178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c52bb-fa01-415f-89e4-b3d8c3b3b957 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:38.709692 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:38.710654 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:38.711026 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:38.711364 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] PATH_INFO: `/v3/projects/5bfe8e2002df4a03b8904d7f8281939a` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:38.712804 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfe8e2002df4a03b8904d7f8281939a)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:38.714855 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:38.761935 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfe8e2002df4a03b8904d7f8281939a', 'request_id': 'req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:38.767203 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfe8e2002df4a03b8904d7f8281939a', 'request_id': 'req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:38.774792 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfe8e2002df4a03b8904d7f8281939a', 'request_id': 'req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:38.786119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] The token cache is being invalidate because project 5bfe8e2002df4a03b8904d7f8281939a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:59:38.786410 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:38.787069 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-ef66de8c-12fb-4d27-ba77-7be6cf8ce9b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:38.788587 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1433/2857] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:59:38 2022] DELETE /identity/v3/projects/5bfe8e2002df4a03b8904d7f8281939a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:57.979874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90da4bd-684b-4961-a15a-81d0225b9880 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:57.981262 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-d90da4bd-684b-4961-a15a-81d0225b9880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:57.993961 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90da4bd-684b-4961-a15a-81d0225b9880 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:58.048654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:58.049505 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:58.049786 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:58.050064 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] PATH_INFO: `/v3/users/ab7566c4d8b9491d8c274c2044630e60` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:58.051273 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7566c4d8b9491d8c274c2044630e60)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:58.053414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:58.097055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7566c4d8b9491d8c274c2044630e60'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:58.103418 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7566c4d8b9491d8c274c2044630e60'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:58.110245 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7566c4d8b9491d8c274c2044630e60'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:58.121489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7566c4d8b9491d8c274c2044630e60'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:58.122135 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7566c4d8b9491d8c274c2044630e60'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:58.127857 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1425/2858] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 16:59:57 2022] DELETE /identity/v3/users/ab7566c4d8b9491d8c274c2044630e60 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:58.133071 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a4213-639d-4642-8a56-5c5389da4efe None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:58.133615 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a4213-639d-4642-8a56-5c5389da4efe None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:58.133732 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a4213-639d-4642-8a56-5c5389da4efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:58.152685 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-fc2a4213-639d-4642-8a56-5c5389da4efe None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:58.153865 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-fc2a4213-639d-4642-8a56-5c5389da4efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:58.211620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1434/2859] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:58.221251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:58.222642 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:58.279403 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53501896-7fac-436a-aff1-832fe3577a27 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:58.283055 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e539e-1829-4cf5-9580-bdc6ae000ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:58.283688 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e539e-1829-4cf5-9580-bdc6ae000ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:58.283969 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e539e-1829-4cf5-9580-bdc6ae000ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:58.284246 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e539e-1829-4cf5-9580-bdc6ae000ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:58.293732 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e539e-1829-4cf5-9580-bdc6ae000ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:58.295193 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e539e-1829-4cf5-9580-bdc6ae000ba7 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:58.304972 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1426/2860] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 16:59:58.558873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a4213-639d-4642-8a56-5c5389da4efe None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:58.560447 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-fc2a4213-639d-4642-8a56-5c5389da4efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:58.572583 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a4213-639d-4642-8a56-5c5389da4efe None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:58.577774 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:58.578613 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:58.578923 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:58.579200 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] PATH_INFO: `/v3/projects/662eb456424e4753b4815d94882641fb` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:58.580384 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662eb456424e4753b4815d94882641fb)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:58.582261 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:58.627805 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662eb456424e4753b4815d94882641fb', 'request_id': 'req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:58.633814 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662eb456424e4753b4815d94882641fb', 'request_id': 'req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:58.641870 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662eb456424e4753b4815d94882641fb', 'request_id': 'req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:58.652592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] The token cache is being invalidate because project 662eb456424e4753b4815d94882641fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 16:59:58.652798 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:58.653407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b033b216-5a69-4b37-ac54-4b55aa0a9ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 16:59:58.654966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1435/2861] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 16:59:58 2022] DELETE /identity/v3/projects/662eb456424e4753b4815d94882641fb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 16:59:58.660800 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f8cb-d5c1-41f8-8e2d-30755ef65b79 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:58.660941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f8cb-d5c1-41f8-8e2d-30755ef65b79 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:58.662152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f8cb-d5c1-41f8-8e2d-30755ef65b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:58.680761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-53c4f8cb-d5c1-41f8-8e2d-30755ef65b79 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:58.681949 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-53c4f8cb-d5c1-41f8-8e2d-30755ef65b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:58.738133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1427/2862] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 24 16:59:58.747240 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f12dfb-adcb-49a1-b193-29f47beca083 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:58.747530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f12dfb-adcb-49a1-b193-29f47beca083 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:58.747812 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f12dfb-adcb-49a1-b193-29f47beca083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:58.766895 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-52f12dfb-adcb-49a1-b193-29f47beca083 None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:58.768088 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-52f12dfb-adcb-49a1-b193-29f47beca083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:58.776431 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1436/2863] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:58.780515 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f8cb-d5c1-41f8-8e2d-30755ef65b79 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:58.790527 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f8cb-d5c1-41f8-8e2d-30755ef65b79 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:58.795305 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dd81f-d8db-4641-9aab-519140189f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:58.795942 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dd81f-d8db-4641-9aab-519140189f3f admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:58.796219 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dd81f-d8db-4641-9aab-519140189f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:58.796488 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dd81f-d8db-4641-9aab-519140189f3f admin admin] PATH_INFO: `/v3/domains` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:58.797211 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290dd81f-d8db-4641-9aab-519140189f3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 24 16:59:58.797517 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290dd81f-d8db-4641-9aab-519140189f3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:58.799119 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290dd81f-d8db-4641-9aab-519140189f3f admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:58.811309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1428/2864] 10.222.0.117 () {58 vars in 1157 bytes} [Mon Jan 24 16:59:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 24 16:59:58.815302 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f12dfb-adcb-49a1-b193-29f47beca083 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:58.824365 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f12dfb-adcb-49a1-b193-29f47beca083 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:58.828958 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba8891-a0dc-4101-b2bf-529fe6852cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:58.829592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8891-a0dc-4101-b2bf-529fe6852cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:58.829874 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8891-a0dc-4101-b2bf-529fe6852cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:58.830150 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8891-a0dc-4101-b2bf-529fe6852cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:58.830887 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba8891-a0dc-4101-b2bf-529fe6852cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:58.832755 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba8891-a0dc-4101-b2bf-529fe6852cb5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:58.857936 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1437/2865] 10.222.0.117 () {60 vars in 1157 bytes} [Mon Jan 24 16:59:58 2022] POST /identity/v3/projects => generated 398 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 24 16:59:58.861954 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dd81f-d8db-4641-9aab-519140189f3f admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:58.872731 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dd81f-d8db-4641-9aab-519140189f3f admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:58.928908 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff050db-1825-4072-9d8d-0ac59866653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:58.929487 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff050db-1825-4072-9d8d-0ac59866653a admin admin] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:58.929764 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff050db-1825-4072-9d8d-0ac59866653a admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:58.930034 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff050db-1825-4072-9d8d-0ac59866653a admin admin] PATH_INFO: `/v3/users` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:58.930736 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff050db-1825-4072-9d8d-0ac59866653a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:58.932644 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff050db-1825-4072-9d8d-0ac59866653a admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:58.952048 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1429/2866] 10.222.0.117 () {60 vars in 1148 bytes} [Mon Jan 24 16:59:58 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 24 16:59:58.956126 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba8891-a0dc-4101-b2bf-529fe6852cb5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:58.966832 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba8891-a0dc-4101-b2bf-529fe6852cb5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:58.971336 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05832994-415f-4e3b-9edc-db6e37d29e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:58.971978 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05832994-415f-4e3b-9edc-db6e37d29e9b admin admin] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:58.972253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05832994-415f-4e3b-9edc-db6e37d29e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:58.972530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05832994-415f-4e3b-9edc-db6e37d29e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:58.973253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05832994-415f-4e3b-9edc-db6e37d29e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:58.975634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05832994-415f-4e3b-9edc-db6e37d29e9b admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:58.985547 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1438/2867] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:58 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:58.989687 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff050db-1825-4072-9d8d-0ac59866653a admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:58.999339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff050db-1825-4072-9d8d-0ac59866653a admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:59.004007 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09067751-628b-45a3-8bfc-7546718bdd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:59.004648 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09067751-628b-45a3-8bfc-7546718bdd70 admin admin] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:59.004932 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09067751-628b-45a3-8bfc-7546718bdd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:59.005209 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09067751-628b-45a3-8bfc-7546718bdd70 admin admin] PATH_INFO: `/v3/roles` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:59.006138 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09067751-628b-45a3-8bfc-7546718bdd70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:59.007752 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09067751-628b-45a3-8bfc-7546718bdd70 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:59.017285 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1430/2868] 10.222.0.117 () {58 vars in 1126 bytes} [Mon Jan 24 16:59:58 2022] GET /identity/v3/roles => generated 1427 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 24 16:59:59.022452 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05832994-415f-4e3b-9edc-db6e37d29e9b admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:59.032002 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05832994-415f-4e3b-9edc-db6e37d29e9b admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:59.037698 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dc224-fddc-4e97-933f-ecc67b98cbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:59.038556 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dc224-fddc-4e97-933f-ecc67b98cbef admin admin] REQUEST_METHOD: `PUT` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:59.038871 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dc224-fddc-4e97-933f-ecc67b98cbef admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:59.039151 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dc224-fddc-4e97-933f-ecc67b98cbef admin admin] PATH_INFO: `/v3/projects/d393b74a0b4e480da79cb97d9ee44ff8/users/bfbd4a858dbf4418b4248b59e1eac3d5/roles/42656495a54b4164862c9a31838a731e` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:59.053925 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294dc224-fddc-4e97-933f-ecc67b98cbef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d393b74a0b4e480da79cb97d9ee44ff8, user_id=bfbd4a858dbf4418b4248b59e1eac3d5, role_id=42656495a54b4164862c9a31838a731e)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:59.056581 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294dc224-fddc-4e97-933f-ecc67b98cbef admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:59.069235 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1439/2869] 10.222.0.117 () {60 vars in 1487 bytes} [Mon Jan 24 16:59:59 2022] PUT /identity/v3/projects/d393b74a0b4e480da79cb97d9ee44ff8/users/bfbd4a858dbf4418b4248b59e1eac3d5/roles/42656495a54b4164862c9a31838a731e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 16:59:59.079572 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c647-1492-4dc1-ad9e-33151c8c6170 None None] REQUEST_METHOD: `POST` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:59.079861 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c647-1492-4dc1-ad9e-33151c8c6170 None None] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:59.080143 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c647-1492-4dc1-ad9e-33151c8c6170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:59.107164 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.auth.core [None req-a2e8c647-1492-4dc1-ad9e-33151c8c6170 None None] MFA Rules not processed for user `bfbd4a858dbf4418b4248b59e1eac3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=90770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 16:59:59.108365 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-a2e8c647-1492-4dc1-ad9e-33151c8c6170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:59.170349 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1431/2870] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 16:59:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 16:59:59.181227 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dc224-fddc-4e97-933f-ecc67b98cbef admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 16:59:59.182892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-294dc224-fddc-4e97-933f-ecc67b98cbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 16:59:59.245076 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dc224-fddc-4e97-933f-ecc67b98cbef admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 16:59:59.248712 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7ab5b-8fc4-4936-bf34-24dd7123087c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 16:59:59.249347 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7ab5b-8fc4-4936-bf34-24dd7123087c service cinder] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 16:59:59.249629 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7ab5b-8fc4-4936-bf34-24dd7123087c service cinder] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 16:59:59.249910 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7ab5b-8fc4-4936-bf34-24dd7123087c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 16:59:59.259027 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7ab5b-8fc4-4936-bf34-24dd7123087c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 16:59:59.260469 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7ab5b-8fc4-4936-bf34-24dd7123087c service cinder] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 16:59:59.269046 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1440/2871] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 16:59:59 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:00:06.208816 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8c647-1492-4dc1-ad9e-33151c8c6170 None None] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:06.268414 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8c647-1492-4dc1-ad9e-33151c8c6170 None None] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:06.273612 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:06.274462 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:06.274734 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:06.275032 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] PATH_INFO: `/v3/users/bfbd4a858dbf4418b4248b59e1eac3d5` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:06.276214 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbd4a858dbf4418b4248b59e1eac3d5)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:06.278100 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:06.321713 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbd4a858dbf4418b4248b59e1eac3d5'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:06.328851 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbd4a858dbf4418b4248b59e1eac3d5'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:06.336380 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbd4a858dbf4418b4248b59e1eac3d5'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:06.347654 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbd4a858dbf4418b4248b59e1eac3d5'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:06.348371 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbd4a858dbf4418b4248b59e1eac3d5'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:06.354293 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1432/2872] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 17:00:06 2022] DELETE /identity/v3/users/bfbd4a858dbf4418b4248b59e1eac3d5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 17:00:06.359005 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37959917-0161-4a2c-ba88-411e35cb93fb None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:06.359517 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37959917-0161-4a2c-ba88-411e35cb93fb None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:06.359620 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37959917-0161-4a2c-ba88-411e35cb93fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:06.377119 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-37959917-0161-4a2c-ba88-411e35cb93fb None None] MFA Rules not processed for user `e3931bcf4ae942f8ab85de758142ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 17:00:06.378330 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-37959917-0161-4a2c-ba88-411e35cb93fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:06.437036 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1441/2873] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 17:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 17:00:06.447806 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:06.449218 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:06.504837 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938b312-7a6b-4c80-8977-43537c745131 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:06.509092 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08ad2c-1055-409b-bae5-abf16d0085de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:06.509721 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08ad2c-1055-409b-bae5-abf16d0085de service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:06.509998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08ad2c-1055-409b-bae5-abf16d0085de service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:06.510270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08ad2c-1055-409b-bae5-abf16d0085de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:06.519129 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08ad2c-1055-409b-bae5-abf16d0085de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:06.520704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08ad2c-1055-409b-bae5-abf16d0085de service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:06.529936 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1433/2874] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:00:06.786664 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37959917-0161-4a2c-ba88-411e35cb93fb None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:06.788164 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-37959917-0161-4a2c-ba88-411e35cb93fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:06.800587 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37959917-0161-4a2c-ba88-411e35cb93fb None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:06.805951 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:06.806828 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:06.807115 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:06.807394 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] PATH_INFO: `/v3/projects/d393b74a0b4e480da79cb97d9ee44ff8` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:06.808599 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d393b74a0b4e480da79cb97d9ee44ff8)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:06.810483 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:06.856605 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd393b74a0b4e480da79cb97d9ee44ff8', 'request_id': 'req-b7b48f79-7feb-42ec-9980-5c59a2069852'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:06.861830 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd393b74a0b4e480da79cb97d9ee44ff8', 'request_id': 'req-b7b48f79-7feb-42ec-9980-5c59a2069852'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:06.868958 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd393b74a0b4e480da79cb97d9ee44ff8', 'request_id': 'req-b7b48f79-7feb-42ec-9980-5c59a2069852'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:06.880382 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] The token cache is being invalidate because project d393b74a0b4e480da79cb97d9ee44ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 17:00:06.880662 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:06.881296 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:06.882868 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1442/2875] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 17:00:06 2022] DELETE /identity/v3/projects/d393b74a0b4e480da79cb97d9ee44ff8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 17:00:46.579275 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08ad2c-1055-409b-bae5-abf16d0085de service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:46.580719 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3c08ad2c-1055-409b-bae5-abf16d0085de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:46.591710 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08ad2c-1055-409b-bae5-abf16d0085de service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:46.638950 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aaaf4-7011-420c-b1bc-39fbeead2c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:46.639591 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aaaf4-7011-420c-b1bc-39fbeead2c79 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:46.639867 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aaaf4-7011-420c-b1bc-39fbeead2c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:46.640138 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aaaf4-7011-420c-b1bc-39fbeead2c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:46.641869 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b66aaaf4-7011-420c-b1bc-39fbeead2c79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:46.710004 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aaaf4-7011-420c-b1bc-39fbeead2c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:46.711474 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aaaf4-7011-420c-b1bc-39fbeead2c79 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:46.720174 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1434/2876] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:00:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:00:47.837892 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:47.839392 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:47.919898 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48f79-7feb-42ec-9980-5c59a2069852 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:47.927904 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630ee9b-fea2-4c80-8186-5128a5fc62e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:47.928957 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630ee9b-fea2-4c80-8186-5128a5fc62e9 service nova] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:47.929319 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630ee9b-fea2-4c80-8186-5128a5fc62e9 service nova] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:47.929686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630ee9b-fea2-4c80-8186-5128a5fc62e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:47.931711 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4630ee9b-fea2-4c80-8186-5128a5fc62e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:47.945178 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630ee9b-fea2-4c80-8186-5128a5fc62e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:47.946733 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630ee9b-fea2-4c80-8186-5128a5fc62e9 service nova] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:47.959018 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1443/2877] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:00:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:00:48.013063 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aaaf4-7011-420c-b1bc-39fbeead2c79 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:48.014563 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-b66aaaf4-7011-420c-b1bc-39fbeead2c79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:48.026795 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630ee9b-fea2-4c80-8186-5128a5fc62e9 service nova] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:48.027792 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aaaf4-7011-420c-b1bc-39fbeead2c79 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:48.027929 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-4630ee9b-fea2-4c80-8186-5128a5fc62e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:48.031678 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96ea5e-e04b-4fbe-9dc3-eff532a072cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:48.032317 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96ea5e-e04b-4fbe-9dc3-eff532a072cb service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:48.032597 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96ea5e-e04b-4fbe-9dc3-eff532a072cb service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:48.032868 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96ea5e-e04b-4fbe-9dc3-eff532a072cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:48.035781 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-bf96ea5e-e04b-4fbe-9dc3-eff532a072cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:48.040464 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630ee9b-fea2-4c80-8186-5128a5fc62e9 service nova] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:48.044140 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507924cc-2f79-494c-8ee5-9fe57c46f460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:48.044717 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507924cc-2f79-494c-8ee5-9fe57c46f460 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:48.045057 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507924cc-2f79-494c-8ee5-9fe57c46f460 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:48.045337 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507924cc-2f79-494c-8ee5-9fe57c46f460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:48.047160 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-507924cc-2f79-494c-8ee5-9fe57c46f460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:48.049404 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96ea5e-e04b-4fbe-9dc3-eff532a072cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:48.051582 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96ea5e-e04b-4fbe-9dc3-eff532a072cb service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:48.057377 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507924cc-2f79-494c-8ee5-9fe57c46f460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:48.058809 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507924cc-2f79-494c-8ee5-9fe57c46f460 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:48.063195 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1435/2878] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:00:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:00:48.068185 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1444/2879] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:00:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 17:00:49.258638 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96ea5e-e04b-4fbe-9dc3-eff532a072cb service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:49.267206 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96ea5e-e04b-4fbe-9dc3-eff532a072cb service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:49.270874 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7f0d-7a77-429b-a774-396f07d820d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:49.271615 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7f0d-7a77-429b-a774-396f07d820d0 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:49.271898 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7f0d-7a77-429b-a774-396f07d820d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:49.272176 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7f0d-7a77-429b-a774-396f07d820d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:49.273946 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-349c7f0d-7a77-429b-a774-396f07d820d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:49.287647 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c7f0d-7a77-429b-a774-396f07d820d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:49.289325 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c7f0d-7a77-429b-a774-396f07d820d0 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:49.299889 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1436/2880] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:00:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:00:51.775306 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507924cc-2f79-494c-8ee5-9fe57c46f460 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:51.783798 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507924cc-2f79-494c-8ee5-9fe57c46f460 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:51.787907 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761fa81-7834-47e2-acab-3d4db88792b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:51.788787 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761fa81-7834-47e2-acab-3d4db88792b5 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:51.789068 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761fa81-7834-47e2-acab-3d4db88792b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:51.789344 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761fa81-7834-47e2-acab-3d4db88792b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:51.791179 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-7761fa81-7834-47e2-acab-3d4db88792b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:51.857246 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761fa81-7834-47e2-acab-3d4db88792b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:51.858705 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761fa81-7834-47e2-acab-3d4db88792b5 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:51.868999 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1445/2881] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:00:58.018202 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7f0d-7a77-429b-a774-396f07d820d0 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:58.019707 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-349c7f0d-7a77-429b-a774-396f07d820d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:58.034960 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7f0d-7a77-429b-a774-396f07d820d0 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:58.042415 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:58.043379 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:58.049150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:58.049150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] PATH_INFO: `/v3/users/ef20979970584d92b04462166e7059b6` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:58.049150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef20979970584d92b04462166e7059b6)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:58.049150 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:58.095667 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef20979970584d92b04462166e7059b6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.104504 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef20979970584d92b04462166e7059b6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.111362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef20979970584d92b04462166e7059b6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.127463 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef20979970584d92b04462166e7059b6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.128133 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef20979970584d92b04462166e7059b6'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.136105 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1437/2882] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 17:00:58 2022] DELETE /identity/v3/users/ef20979970584d92b04462166e7059b6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 17:00:58.309873 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761fa81-7834-47e2-acab-3d4db88792b5 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:58.320135 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761fa81-7834-47e2-acab-3d4db88792b5 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:58.377707 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:58.378570 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:58.378890 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:58.379169 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] PATH_INFO: `/v3/projects/511e72017a4b4da7a0748dae5a59e0ac` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:58.380414 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=511e72017a4b4da7a0748dae5a59e0ac)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:58.382300 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:58.426596 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511e72017a4b4da7a0748dae5a59e0ac', 'request_id': 'req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.432264 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511e72017a4b4da7a0748dae5a59e0ac', 'request_id': 'req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.439124 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511e72017a4b4da7a0748dae5a59e0ac', 'request_id': 'req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.450315 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] The token cache is being invalidate because project 511e72017a4b4da7a0748dae5a59e0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 17:00:58.450600 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.451253 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.452760 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1446/2883] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 17:00:58 2022] DELETE /identity/v3/projects/511e72017a4b4da7a0748dae5a59e0ac => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 17:00:58.456814 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:58.459043 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:58.471755 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf70fee-7d0a-4921-a16d-934e176402d7 admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:58.528047 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:58.528941 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:58.529222 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:58.529497 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] PATH_INFO: `/v3/users/a0aba7b875194e7e8a6426648f0b12bb` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:58.530711 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0aba7b875194e7e8a6426648f0b12bb)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:58.533081 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:58.578863 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0aba7b875194e7e8a6426648f0b12bb'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.586499 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0aba7b875194e7e8a6426648f0b12bb'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.593559 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0aba7b875194e7e8a6426648f0b12bb'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.604952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0aba7b875194e7e8a6426648f0b12bb'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.605619 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0aba7b875194e7e8a6426648f0b12bb'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.611270 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1438/2884] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 17:00:58 2022] DELETE /identity/v3/users/a0aba7b875194e7e8a6426648f0b12bb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 17:00:58.779033 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:00:58.780557 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:00:58.794485 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a85a93-03a8-44e2-90a4-f674d0f0fe7c admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:00:58.853894 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:00:58.854767 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:00:58.855052 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:00:58.855325 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] PATH_INFO: `/v3/projects/c9990d4896bc4ec48723c91c13213cc5` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:00:58.856520 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9990d4896bc4ec48723c91c13213cc5)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:00:58.858398 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:00:58.904309 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9990d4896bc4ec48723c91c13213cc5', 'request_id': 'req-a366ef99-f368-4371-8f56-47d93585ab90'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.909519 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9990d4896bc4ec48723c91c13213cc5', 'request_id': 'req-a366ef99-f368-4371-8f56-47d93585ab90'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.916937 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9990d4896bc4ec48723c91c13213cc5', 'request_id': 'req-a366ef99-f368-4371-8f56-47d93585ab90'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.928091 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] The token cache is being invalidate because project c9990d4896bc4ec48723c91c13213cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 17:00:58.928375 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.929000 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-a366ef99-f368-4371-8f56-47d93585ab90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:00:58.930512 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1447/2885] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 17:00:58 2022] DELETE /identity/v3/projects/c9990d4896bc4ec48723c91c13213cc5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 17:01:06.152348 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:01:06.153704 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:01:06.210197 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6f693-24af-4182-9af4-657fd866873d admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:01:06.257672 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f9ec3-ba6d-4c01-9ecb-abe765b6e766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62250938c543d788dd7fd690b5abad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:01:06.258362 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f9ec3-ba6d-4c01-9ecb-abe765b6e766 service cinder] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:01:06.258729 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f9ec3-ba6d-4c01-9ecb-abe765b6e766 service cinder] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:01:06.259137 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f9ec3-ba6d-4c01-9ecb-abe765b6e766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:01:06.260739 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-345f9ec3-ba6d-4c01-9ecb-abe765b6e766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:01:06.336309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f9ec3-ba6d-4c01-9ecb-abe765b6e766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:01:06.337771 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f9ec3-ba6d-4c01-9ecb-abe765b6e766 service cinder] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:01:06.346864 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1439/2886] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:01:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:01:13.176516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60eb35-f23b-469b-bcbe-bcf2564cf436 None None] REQUEST_METHOD: `POST` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:01:13.177391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60eb35-f23b-469b-bcbe-bcf2564cf436 None None] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:01:13.177391 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60eb35-f23b-469b-bcbe-bcf2564cf436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:01:13.200359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.auth.core [None req-8a60eb35-f23b-469b-bcbe-bcf2564cf436 None None] MFA Rules not processed for user `40a416737b484014bb7cf011bab63b63`. Rule list: `[]` (Enabled: `True`). {{(pid=90771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 24 17:01:13.202181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8a60eb35-f23b-469b-bcbe-bcf2564cf436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:01:13.211149 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1448/2887] 10.222.0.117 () {58 vars in 962 bytes} [Mon Jan 24 17:01:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 24 17:01:13.561522 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f9ec3-ba6d-4c01-9ecb-abe765b6e766 service cinder] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:01:13.563053 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-345f9ec3-ba6d-4c01-9ecb-abe765b6e766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:01:13.622345 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f9ec3-ba6d-4c01-9ecb-abe765b6e766 service cinder] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:01:13.625907 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16745a77-1d5c-4b35-85be-bba0dd8c81a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:01:13.626540 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745a77-1d5c-4b35-85be-bba0dd8c81a8 service neutron] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:01:13.626917 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745a77-1d5c-4b35-85be-bba0dd8c81a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:01:13.627196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745a77-1d5c-4b35-85be-bba0dd8c81a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:01:13.629761 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-16745a77-1d5c-4b35-85be-bba0dd8c81a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:01:13.639808 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16745a77-1d5c-4b35-85be-bba0dd8c81a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:01:13.642046 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16745a77-1d5c-4b35-85be-bba0dd8c81a8 service neutron] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:01:13.650469 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1440/2888] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:01:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:01:14.117980 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60eb35-f23b-469b-bcbe-bcf2564cf436 None None] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:01:14.119423 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-8a60eb35-f23b-469b-bcbe-bcf2564cf436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:01:14.212821 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60eb35-f23b-469b-bcbe-bcf2564cf436 None None] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:01:14.218718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503f26d-f324-4461-8303-7c9f0a5ca3e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15975bd016ed48f9bf5c88845180ebf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:01:14.219407 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503f26d-f324-4461-8303-7c9f0a5ca3e8 service placement] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:01:14.220092 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503f26d-f324-4461-8303-7c9f0a5ca3e8 service placement] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:01:14.220385 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503f26d-f324-4461-8303-7c9f0a5ca3e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:01:14.222166 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-9503f26d-f324-4461-8303-7c9f0a5ca3e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:01:14.235626 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503f26d-f324-4461-8303-7c9f0a5ca3e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:01:14.237196 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503f26d-f324-4461-8303-7c9f0a5ca3e8 service placement] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:01:14.256967 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1449/2889] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:01:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 24 17:01:26.695674 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16745a77-1d5c-4b35-85be-bba0dd8c81a8 service neutron] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:01:26.697251 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-16745a77-1d5c-4b35-85be-bba0dd8c81a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:01:26.771389 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16745a77-1d5c-4b35-85be-bba0dd8c81a8 service neutron] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:01:26.777657 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841abb-bd20-4576-88c2-e57018677fae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:01:26.778309 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841abb-bd20-4576-88c2-e57018677fae service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:01:26.778592 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841abb-bd20-4576-88c2-e57018677fae service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:01:26.778952 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841abb-bd20-4576-88c2-e57018677fae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:01:26.780656 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-79841abb-bd20-4576-88c2-e57018677fae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:01:26.792815 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79841abb-bd20-4576-88c2-e57018677fae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:01:26.794370 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79841abb-bd20-4576-88c2-e57018677fae service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:01:26.804673 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1441/2890] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:01:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:01:28.687540 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503f26d-f324-4461-8303-7c9f0a5ca3e8 service placement] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:01:28.697938 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503f26d-f324-4461-8303-7c9f0a5ca3e8 service placement] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:01:28.701634 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6f39c-638b-439e-90ac-d2f790ecd993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:01:28.702256 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6f39c-638b-439e-90ac-d2f790ecd993 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:01:28.702530 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6f39c-638b-439e-90ac-d2f790ecd993 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:01:28.702835 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6f39c-638b-439e-90ac-d2f790ecd993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:01:28.704647 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-2ee6f39c-638b-439e-90ac-d2f790ecd993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:01:28.764576 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6f39c-638b-439e-90ac-d2f790ecd993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:01:28.765984 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6f39c-638b-439e-90ac-d2f790ecd993 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:01:28.775334 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1450/2891] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:01:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:01:30.600358 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841abb-bd20-4576-88c2-e57018677fae service nova] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:01:30.612217 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841abb-bd20-4576-88c2-e57018677fae service nova] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:01:30.617804 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd635d0-ebba-443e-9926-1e5058629f39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c91fefe89a45b48df82a311e771ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:01:30.618596 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd635d0-ebba-443e-9926-1e5058629f39 service nova] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:01:30.618919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd635d0-ebba-443e-9926-1e5058629f39 service nova] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:01:30.619196 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd635d0-ebba-443e-9926-1e5058629f39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:01:30.621012 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-4dd635d0-ebba-443e-9926-1e5058629f39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:01:30.634501 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd635d0-ebba-443e-9926-1e5058629f39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:01:30.635797 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd635d0-ebba-443e-9926-1e5058629f39 service nova] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:01:30.646998 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1442/2892] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:01:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:03:24.019399 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6f39c-638b-439e-90ac-d2f790ecd993 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:03:24.055598 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6f39c-638b-439e-90ac-d2f790ecd993 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:03:24.059318 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc23747-50aa-475a-b182-1f63e7c5d2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9834b75e2b4ac787f3917564090d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:03:24.059947 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23747-50aa-475a-b182-1f63e7c5d2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:03:24.060232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23747-50aa-475a-b182-1f63e7c5d2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:03:24.060508 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23747-50aa-475a-b182-1f63e7c5d2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:03:24.062265 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-1bc23747-50aa-475a-b182-1f63e7c5d2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:03:24.174544 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc23747-50aa-475a-b182-1f63e7c5d2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:03:24.176588 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc23747-50aa-475a-b182-1f63e7c5d2c2 service neutron] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:03:24.196080 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1451/2893] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 24 17:03:30.540399 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd635d0-ebba-443e-9926-1e5058629f39 service nova] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:03:30.541923 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-4dd635d0-ebba-443e-9926-1e5058629f39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:03:30.593996 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd635d0-ebba-443e-9926-1e5058629f39 service nova] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:03:30.598773 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:03:30.599747 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:03:30.600025 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:03:30.600297 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] PATH_INFO: `/v3/users/40a416737b484014bb7cf011bab63b63` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:03:30.601489 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a416737b484014bb7cf011bab63b63)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:03:30.603449 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:03:30.649170 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a416737b484014bb7cf011bab63b63'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:30.656438 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a416737b484014bb7cf011bab63b63'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:30.663536 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a416737b484014bb7cf011bab63b63'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:30.675024 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a416737b484014bb7cf011bab63b63'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:30.675718 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a416737b484014bb7cf011bab63b63'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:30.682341 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1443/2894] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 17:03:30 2022] DELETE /identity/v3/users/40a416737b484014bb7cf011bab63b63 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 24 17:03:30.853592 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc23747-50aa-475a-b182-1f63e7c5d2c2 service neutron] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:03:30.863924 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc23747-50aa-475a-b182-1f63e7c5d2c2 service neutron] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:03:30.921312 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:03:30.922162 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:03:30.922445 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:03:30.922718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] PATH_INFO: `/v3/projects/7a337369b3dc467394f2629fb2f8487c` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:03:30.923933 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a337369b3dc467394f2629fb2f8487c)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:03:30.925822 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:03:30.971989 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a337369b3dc467394f2629fb2f8487c', 'request_id': 'req-e73d070d-ee1f-47b4-af41-9ada1e7760d5'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:30.978075 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a337369b3dc467394f2629fb2f8487c', 'request_id': 'req-e73d070d-ee1f-47b4-af41-9ada1e7760d5'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:30.984516 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a337369b3dc467394f2629fb2f8487c', 'request_id': 'req-e73d070d-ee1f-47b4-af41-9ada1e7760d5'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:30.996171 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] The token cache is being invalidate because project 7a337369b3dc467394f2629fb2f8487c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 17:03:30.996453 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:30.997097 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:30.998609 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1452/2895] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 17:03:30 2022] DELETE /identity/v3/projects/7a337369b3dc467394f2629fb2f8487c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 17:03:31.002693 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:03:31.004159 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:03:31.017233 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba8f1-df17-4f4e-9133-49a94c1b157e admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:03:31.073339 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:03:31.074152 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:03:31.074440 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:03:31.074716 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] PATH_INFO: `/v3/users/9f3da4e5da5643799926f134bd7ee135` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:03:31.075934 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3da4e5da5643799926f134bd7ee135)` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:03:31.077871 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:03:31.120717 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3da4e5da5643799926f134bd7ee135'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:31.126951 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3da4e5da5643799926f134bd7ee135'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:31.134577 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3da4e5da5643799926f134bd7ee135'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:31.146882 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3da4e5da5643799926f134bd7ee135'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:31.147578 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.notifications [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3da4e5da5643799926f134bd7ee135'} {{(pid=90770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:31.153702 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1444/2896] 10.222.0.117 () {58 vars in 1228 bytes} [Mon Jan 24 17:03:31 2022] DELETE /identity/v3/users/9f3da4e5da5643799926f134bd7ee135 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 17:03:31.322131 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] Authenticating user token {{(pid=90771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:03:31.323718 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.fernet_utils [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:03:31.338232 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d070d-ee1f-47b4-af41-9ada1e7760d5 admin admin] Validating token access rules against request {{(pid=90771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:03:31.394966 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3931bcf4ae942f8ab85de758142ef39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e0f1fba09874be8ae22b37e033b5e57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:03:31.395823 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:03:31.396103 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] SCRIPT_NAME: `/identity` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:03:31.396380 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] PATH_INFO: `/v3/projects/9c788630268b42d8ad7b2ea44bb36048` {{(pid=90771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:03:31.397686 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c788630268b42d8ad7b2ea44bb36048)` {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:03:31.399670 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] RBAC: Authorization granted {{(pid=90771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:03:31.445864 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c788630268b42d8ad7b2ea44bb36048', 'request_id': 'req-b9a7464e-2d1b-4685-961e-82ed1c623552'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:31.451181 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c788630268b42d8ad7b2ea44bb36048', 'request_id': 'req-b9a7464e-2d1b-4685-961e-82ed1c623552'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:31.458359 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c788630268b42d8ad7b2ea44bb36048', 'request_id': 'req-b9a7464e-2d1b-4685-961e-82ed1c623552'} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:31.468934 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] The token cache is being invalidate because project 9c788630268b42d8ad7b2ea44bb36048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 24 17:03:31.469222 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:31.469843 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: DEBUG keystone.notifications [None req-b9a7464e-2d1b-4685-961e-82ed1c623552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 24 17:03:31.471405 dv-cinder-826116-1-iscsi devstack@keystone.service[90771]: [pid: 90771|app: 0|req: 1453/2897] 10.222.0.117 () {58 vars in 1237 bytes} [Mon Jan 24 17:03:31 2022] DELETE /identity/v3/projects/9c788630268b42d8ad7b2ea44bb36048 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 24 17:04:38.166593 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] Authenticating user token {{(pid=90770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 24 17:04:38.168065 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:04:38.253781 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1d99a-f7f7-4267-ab1b-5771a083a0ef admin admin] Validating token access rules against request {{(pid=90770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 24 17:04:38.309331 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b8ccb-8bba-4321-ba6a-8be3545b2c36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15975bd016ed48f9bf5c88845180ebf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ec70d8afc7144bd9fc12156d01e6855', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 24 17:04:38.309958 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b8ccb-8bba-4321-ba6a-8be3545b2c36 service placement] REQUEST_METHOD: `GET` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 24 17:04:38.310235 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b8ccb-8bba-4321-ba6a-8be3545b2c36 service placement] SCRIPT_NAME: `/identity` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 24 17:04:38.310506 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b8ccb-8bba-4321-ba6a-8be3545b2c36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 24 17:04:38.312292 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.fernet_utils [None req-539b8ccb-8bba-4321-ba6a-8be3545b2c36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 24 17:04:38.323581 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b8ccb-8bba-4321-ba6a-8be3545b2c36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 24 17:04:38.325122 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b8ccb-8bba-4321-ba6a-8be3545b2c36 service placement] RBAC: Authorization granted {{(pid=90770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 24 17:04:38.334919 dv-cinder-826116-1-iscsi devstack@keystone.service[90770]: [pid: 90770|app: 0|req: 1445/2898] 10.222.0.117 () {60 vars in 1370 bytes} [Mon Jan 24 17:04:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)